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Aba tract* This thesis examines a tactile sensor and a thermal pernor far use 
With the Utah-MIT dexterous four Angered hand. Sensory Feedback is critical f-nr 
full utilization of its advanced manipulatory capabilities. The band itadf provides 
tendon tensions and joint angles information. However, planned control algorithms 
require more inform ation than these sources can provide. 

The tactile sensor utilizes capaeitive transduction with a novel design ba^cd 
entirely on silicone elastomers. It provides an 8 x g array of force cells with 1.9 mm 
center- to-center spacing, A pressure resolution of 8 significant bits is available over 
a to 200 grains per square mm. range. The thermal sensor measures a material's 
heat conductivity by radiating heat into an object and measuring the resulting 
temperature variations. This sensor has a 4 x 4 array of temperature celts with 
3.5 mm center-to-center spacing. Experiments show that the thermal SCU&or can 
discriminate among material by detecting differences in their thermal conduction 
properties. Both sensors meet the stringent mounting requirements posed by the 
Utah-MIT hand. Combining them together to form a sensor with both tactile and 
thermal capabilities will ultimately be possible. 

The computational requirements for controlling a sensor equipped dexterous 
hand are severe. Conventional single processor computers do not provide adequate 
performance. To overcome these di (lieu I lies, a computational architecture based 
on interconnecting high performance microcomputer* and a sat of software prim- 
itives tailored for sensor driven control has been proposed. The system has been 
implemented and tested on the Utah-MIT hand. 

The hand j equipped with tactile and thermal sensors and controlled by its COIuV 
putational architecture, is one of the most advanced robotic manipulatory devices 
available worldwide. Other ongoing projects will exploit these tools and allow the 
band to perform tasks that exceed the capabilities of current generation robots. 
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Human hands have amazing versatility. Think oF the wide variety of tasks that we 
dforllcsKLy perform with them each day, They are used For manipulating objects, 
static, grasping, and exploratory motions. Our hands are so effective at what they 
do that we often take them for granted. Take the task of pulling change out of a 
pocket. Since visual information is of no use tor this operation, our hand** tactile 
capabilities play a, crucial role in locating a coin, Then, our hugeis readily grasp the 
coin and perhaps re-orient it for better stability. Thermal sensing capabilities can 
also play a role by distinguishing the metal of the change from other objects that 
might be in the pocket. Finally, the soft surfaces of our finger Lips helps prevent 
the coin from slipping. 

Our hands perform so many tasks with ease that they must have a particularly 
cfFcctive design. Even more amazingly, they operate in entirely unstructured envi- 
ronments. When we are mending clothing :io special jigs for accurate placement 
of stitches are required. Instead, our hande pick up the fabric and start sewing. 
Our fingers can position the msuei-ial ,1m! move around the needle without any 
assistance. 

In some cases our hands are not capable of performing a task alone and tools 
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are required to help out, But think of how easily hands can use looia. It. is hard to 
nuajskie a :ilutc versatile manipulatory system, than a pair of hands with a suitable 
set of tools, In fact, the power of oar hands and their ability to operate tools may 
very well be responsible for our success as a species. 

Today's robotic end efler tors,, on the other hand, cannot rival the performance of 
our hands. One of their biggest deficiencies is that they m«at operate in structured 
environments. It is assumed that the objects they manipulate are 'well modeled and 
that, their positions are accurately known. When the structuring assumptions that 
have been made fall, the Tobot is often helpless and cannot perform the desired taEk 
correctly. They usually lack the kinds of sensory feedback necessary for analysing 
the world and modifying their actions to compensate for problems. 

In addition to a lack of sensing capabilities, their mechanical dexterity Is also not 
adequate Tor operating in an unstructured environment. Special jigs are required 
to make up for a robot's lack of flexibility. The cost involved with making a 
robot'* workspace Suitable for it to operate in often exceeds the cost of the robot 
itself, Many manufacturing and assemlil}' operations cannot be automated because 
of these severe limitations. More importantly, some uses for robots are entirely 
precluded hy their need for a structured environment. 

Before robotic hands suitable for operation in unstructured environments can 
be made, advances in manipulators, actuators, Sensors, computer controllers,, con- 
trol laws, planners, and robot programming languages are needed. Manipulators 
must be made more dexterous to permit complex grasping and orientation strate- 
gies. Actuators muR* be made faster and more compact. Sensors must be durable, 
and, should provide iuformati on that ir.sjre the. robot correctly performs its task. 
Computers need to be more powerful to handle the increased mechanical dexterity 
and the wealth of sensory data. Control laws must be extended to handle the me- 
chanical structure of the advanced manipulators. Finally, tools, must be developed 
to reduce the difficulty of programming a complex robot. 

Investigation of eras pine; and manipulatory strategics for a sensor equipped 
hand are needed before hurnaa-iita performance can be achieved. One of the many 
open questions in hand control is how to determine the most effective grasp orien- 
tation for a particular object geometry. The definition of "most effective* depends 
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on the particular operation intended; for some tasks a power grip that imparts 
maximum holding force onto an object i& best. Other times, a motility grip that 
givfiR an object its yreatest range of motions would be preferred. 

Contact sensors provide in Formation that can simplify grasping operations. One 
important use for this information 1& to verify a grip h s stability, If a grip fe failing, 
contact sensors can provide information on the direction the object is slipping, 
possibly allowing corrective action to be taken. If the angle of contact between 
a finger anil an object is approaching the limits of the contact ftlctional cone, 
indicating that an unstable situation may be imminent, the finger orientations can 
be modified. 

D cheats operations also require sensory feedback. To avoid breaking an cy*;, 
for example, the Einger n B contact force must be small > yet large enough to avoid 
slippage,. Programming a hand lo write or. paper probably requires careFully mon- 
itoring the position of the pen with respect lo the fingers and paper. Flipping the 
pages of a book is tricky re well; a Light grip on the paper is required to avoid rip- 
ping the page,, while enough contact force must be applied to generate the friction 
needed to flip the Gheet upward, These operations are even hard for humans, as 
we all know from experience.' 

The rewards, for building an advanced dexterous robot that rivals human per- 
formance are great,. Assembly operations could be more highly automated. Special 
purpose part feeders might be replaced by a more general purpose hand. Contact 
sensors- could resolve a part's location and orientation, allowing the assembly op- 
eration to proceed smoothly. Thermal sensors could assist in selecting a particular 
object from a bin of parts. For Insertion operations the tactile system could detect 
jams, and then direct the hand to take the appropriate corrective action. A robot 
polishing a material's surface could use texture detection to judge the quality of 
-lie finish. 

A robot end effector that can operate in an unstructured environment will do 
more than advance the state of industrial automation, it tan also relieve humans 



'Humans, of counc, team from their nti&U.k«a. Ideally, a band should also Eren^fit from its failure. 
Contact aenaon can a|jjf? provide important infw.HyB.tUHi far ■.ubaina.ticji.l1y di&grn»ui£ vth.y the 
planned opurat io-n fjuled, and Wait future corrective acting would iM b-fiBt to take. 
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of taske that they should not be performing, Undersea, exploration* nuclear power 
plant repair, space exploration, and rescue operations ate hazardous and unpleasant 
for humans to perform. An advanced dexterous robot that can operate in an 
unstructured environment could be put to good use in these areas. 

A hand can be used for more than just grasping and manipulating objects. 
Hapt-lcK n where the hand is used as an exploratory tool, is another important ap- 
plication. .Exploratory motion is highly Eensory driven, both contact sensors and 
joint positions provide information about an object and its environment. Texture 
and thermal clues can help a robot identify a material. Tracking an edge or seam 
to ascertain an object's outline can be done with tactile feedback. Detecting the 
orientation of a small part using its force contact profile is possible. Identifying 
a grasped object by mappang the finger contact locations and material type at 
those contact points to a library model has. already been theoretically studied by 
Grinison and Lojcano-Ferea |1085], The use of a hand aa a sensory organ allows a 
robot to f!\ptare its environment and gather information that will help it perform 
Its manipulatory functions successfully. 

By building and progr<ic;ir-ii:j<; a robotic device with performance capabilities 
similar to that of a hand n we can better understand bioiugkal motor control, In- 
stead of just speculating on how the brain controls out hands, and on how sensory 
data is utilised b we can actually test theories on the robotic device. We can also go 
the other direction. That is, by studying human motion strategies we can develop 
better robotics control techniques, A manipulator with human-like mechanical and 
sensor capabilities allows us to use the every day experience we have using our own 
hands when programming the robotic hand. 

This thesis concentrates on two of the aforementioned problems: the lack of 
adequate sensors and the need for high performance computer controllers. Tn the 
next section, an overview of some basic sensor driven control task& that a dexterous 
hand could perforin is presented . The introduction then concludes with an overview 
of the work covered in the remainder of this thesis. 



§f.l Relation in Other Scnxinf} hfadtilitics 



1.1 K elation to Other Sensing Modalities 

Sensors can be classified within the two broad categories of "non-contact" and 
"contact 11 devices. As one might ascertain from their names, non-con t-act sensors 
extract information passively, without making contact with the objuct being ob- 
served. Contact sensors, however, gather information by probing, poking, and 
otherwise disturbing the object at hand. 

Vision is perhaps the most important non-contact sense that humans, and ForrnR 
robots, utilize. Sight gives a wealth of Information about aspects of an environment 
that are unavailable to other sensory modalities. Ueae for robotic vision systems 
include parts inspection, object identification, and character recognition. 

It should be noted that machine vision can provide some, but not all. of the 
functionality of a contacL sensing device. Thermal properties other than an object's 
temperature can only be obtained by a contact sensor. While vision can give useful 
views of an object provided adequate Lighting L3 available, a contact SCuaor can 
provide some of the same information In the dark. An objects surface profile 
and texture can only be indirectly obtained from vision, with variations in Lighting 
conditions and viewing angles affecting the results. Clearly, a contact sensor obtains 
this information more accurately. 

Various other non-contact sensations arc useful at times, Sound detection pro- 
vides information in assembly operations. The "click" of two fastener coming 
together is a good indication that the task was completed successfully. Sonar Is 
often used to help mobile robots navigate through rooms., and to help bats navigate 
through caves. 

Another non-contact sense that most humans have, and some robots may have 
in the near future t is smell. Smells add not only to our taste of foods but they 
provide warnings of hazards that a visual system could not detect it&df. A robotic 
rWMS, developed by Ikegami and Kaueyasu flfiftS;, duplicates some of the human ! 's 
abilities., and can be put to use in situations where a Ltuinan would rather no£ be 
snifLing. 

Fusion of data from multiple sensor aourtcs supplemented by a knowledge base 
describing, world objects will ultimately be possible. Using information contributed 
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by different sensing modalities reduces the chance of error, increasing the robustness 
of the overall system. Humans have a very robust integrated and intelligent sensor 
system. We receive information from touch, sound,, sight, and smell. The brain 
uses dues extracted from these sources, along with general knowledge of our world, 
to make all its sensor related decisions. 

Sensors play an important role in the development of a dexterous robot capable 
of operating in an unstructured environment, The next section discusses how to 
design them, 

1.3 A Sensor Design Methodology 

The design of contact Sensors should not be d&nc in an ad hoc fashion. In particular, 
a number of questions should be answered before undertaking actual development. 
The following paragraphs pnse these questions and then discuss their relevance to 
the sensor design process. 

What do y&u irani to wmt? This question is not as obvious as it might seem. 
In many cases the answer depends on the sensor's intended uses. Tactile sensors, 
for example, mean different things to different people. For one particular applica- 
tion an array or binary contact detectors might suffice. Other applications mi pint 
require 16 bits of force data, or shear detection in addition to surface normal force 
information. Slip detection Is often cited as an important capability for sensors. 
Without a clear idea of the sensor's intended function, it is very hard to build a 
useful device. 

Haw da you $n about sensing this quantity? Before a sensor can be designed, 
there must be a clear understanding of the phenomenon being sensed, and how 
it manifests itself on the environment, In the case of slip detection for example, 
it is not obvious what a slipping object does to a grip per that would indicate 
that it is really slipping. It ie important to notice that this question should be 
answered separately from, the question concerning the transduction technology to 
be employed. For example, to detect contact profiles a sensor must measure how 
its surface deflects when pressed against an object. So, contact profiles are sensed 
by measuring a surface deformation. Till* observation does not have any bearing 
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on what particular transduction technology should be used, 

Where is the Sensor la be uaed? The selection of an actual transduction process 
must lake into account such practical issues as how much space is available for 
mounting the device. Equally important is to ascertain the expected operating 
environment. For example, will the device need Special protection against damage? 
Special issues covering the packaging should also be addressed. A tactile sensor, 
for example, might need a compliant covering to increase fricliolial contact with 
a grasped object and for protection. Notke that thesE requirements, can Interact 
with the transduction mechanism. Providing a compliant covering might reduce 
force sensing resolution, for example- 

iVhat transduction processes Can be used? The answer* to previous questions 
guide in answering this question- For exampk, if the sensor measures force by 
inducing a positional change In a m^r-rial, the transduction process must delect 
this positional change. If there is no transduction process capable of detecting the 
environ men ta! disturbance of interest, the previous question concerning what one 
wants to sense will need to be re-examined. 

How docs the selected transduction process writ? A full understanding of the 
transduction process will allow the sensor's performance to be optimised. In addi- 
tion, flaws With the approach, if" any, ran. he detected. The model of the transduc- 
tion process should incorporate the sensor** interaction with its environment. 

//rMr.' should the sensor be- fabricated? The answer la this question must Incorpo- 
rate the answers to all the previous questions. The ultimate fabrication techniques 
chosen should provide packaging suitable for both the transduction principles em- 
ployed and for the intended use of the device; a tactile sensor that passed all 
performance specification with flying colors is of little use if it is too big to fit in 
its intended mounting location. 

To begin the design process for the tactile and thermal sensors described within 
this report, a, discussion of the Utah-MIT hand is necessary. This provides an 
answer to one of the most important of the previous questions: where the sensors 
are to be mounted. 
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Figure 1.1: Ph9tosnph vf Tht UUh-MIT H<ni& 



1A The Utah-MIT Hand 



The Center for Engineering Design at the University of Utah and the Artificial In- 
telligence Laboratory at the Massachusetts Institute of Technology are developing 
n multi-fingered robot hand to pursue the achievement of advanced robot dexter- 
ity |Jacobscn et ah 19S4]. The Utah-MIT hand has been made of approximate 
anthropomorphic size and design, partly because the human hand is obviously a 
particularly effective design^ and partly because existing experience in using out 
own Jmndg can aid in thinking of control strategies for the robot hand, The hand 
has four fingers, arranged as three fingers in a. planar sequence and an opposing 
thumb. Each finger has four deg:eeR of freedom, simitar to a human finger save that 
the two degree of freedom knuckle joint is split into separate abduction/ adduction 
and flexion/ extension joj nts for technical reasons of tendon routing. Four fingers 
were -ch.O&Cil as a COmpronniHe to provide more Functional capability than a three 
fingered hand | Mason and Salisbury 19S5; Qkada 19?9| because of object re-Ori- 
entation ability and hand shaping functions, yet to avoid the added mechanical 
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Figure 1.2: The Utah-MIT A and 1 p^$ilit>niriij laUe. 



complexity of five fingers. 

Each finger is driven by 8 tendons, which is 3 more than required by the it+ 1 

minimum rule for tendonE versus degreeE of freedom [Mason and Salisbury 1,985], 
Tin. 1 trajmmiaaion and actuation systems are two of the more novel Papeete of this 
hand design. The tendons are composed of specially woven keviar tapes,, routed 
by pulleys across the finger joints and the wrist to the forearm actuator assembly. 
The 32 eiectropneumatic actuators have favorable power to weight ratios and can 
be adequately controlled for force. Sensor arc provided for Lcndon tension and joint 
positions. 

The hand Itscif is mounted onto the z axis of a 3 degree-of-freedom positioning 
tabte (Figure 1,2), The table's surface moves in the sjr plane, while the z axiE 
is. translated by an independent y axis. The redundant y motion permits flxper- 
irnentation with tracking, operations; an object moving in the y direction of the 
positioning surface can be independently tracked by the hand. 
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1.4 Scope of this Thesis 

This thesis is motivated by the need to cg.uip the Utah-MIT dexterous hand with 
contact sensors. Initially, an examination of commercially produced sensors pro- 
duced disappointing findings. No devices suitable Tor mounting on the fingers of 
the hand were found, Research sensors were more promising^ but there were still 
no refined technologies that could be directly used in this project, In fact, the 
performance requirements we set for the tactile sensor were not all that stringent; 
it wus the space and mounting constraints, as well as reliability issues, that became 
limiting factors, Thermal sensors were in a much less developed state. Only at 
the completion of this project did we discover another thermal sensing effort, con- 
ducted concurrently and independently of this work [Russell 1Q8S],, that examined 
some of the same issues covered in this thesis. 

The tactile sensor is based on variations, in the distance between two parallel 
plates of a capacitor Siege] et al. 1S85|. Ah force on a sensor point is increased, 
the gap Between the plates of a capacitor will decrease. The measured capacitance 
is related to the distance between the plates, and hence the force being applied 
at that point, A & x 8 array of capacitor cells is used, giving the device 64 force 
sensitive tactile points. 

Thermal sensors can provide useful information about a manipulator 1 '!; envi- 
ronment. These devices are designed to measure the properties of a material that 
are related to its heat conduction and heat capacity, as well as its absolute tem- 
perature. This sensing modality has received little attention in the literature.,, yet 
it can provide information that cannot be obtained from vision or tactile sensors 
alone. Humans, For example, have little trouble distinguish in pj metal from plastic. 
The great difference in their thermal conduction characteristics give the metal a 
distinctively cooler feeling. 

The thermal sensor measures heat conduction by actively applying heat to 
an abjcct b and measuring the temperature changes at the sensor's surface |Sicejel 
and Simmons l£Si]. If the material the sensor is in contact with is a good heat 
conductor, the surface temperature of the sensor will rapidly decline. Thi& device 
uses surface mounted thermistors for temperature measurement and has a 4 X 4 
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array of thermal detection cells. 

Since the potential usefulness of sensors is heavily dependent on their reliability* 
sensitivity, and packaging,, much attention is given to these considerations. A 

detailed act of performance experiments was conducted for both the tactile and 
thermal prototypes to- fully quantify their capabilities.. The motivation for the 
particular experiments chosen is carefully discussed, In current literature, sensor 
performance 3a commonly characterized in an ad hoc. fashion, making comparisons 
difficult. 

The performance experiments conducted show that the sensors can be used Sn 
a number of useful ways. The tactile device's spatial resolution is sufficient for 
identification of small objects by recording their contact profiles. Objects larger 
than the sensor can be characterized by a groping strategy. The tactile sensor can 
classify the contact type between an object and its surface; discrimination between 
point, line-,, and plane contact is possible. The thermal sensor can identify materials 
in contact with r.s surface, 

A .sensor equipped hand alone cannot perform useful Operations. High per- 
formance computers are required for the computationally complex seiiaor-based 
control strategies envisioned. This thesiE also discusses a multiprocessor based 
computational architecture suitable for these needs. The system LS based on high 
performance: single board computers interconnected via a shared memory bus. 
Commercial products were cboscn over custom designed hardware to reduce the 
system's development time. 

To summarize,, the important issues to be investigated in this project include: 

» Packaging: most device* do not have suitable packaging for installation on 
the Utah-MIT hand 1 s fingers. Many sensors are too Large to fit within the 

tight space constraints at the mounting sites, and cannot bend around the 
curved surfaces of the fingers, 

* Reliability: many sensors lack the reliability needed for repeated use in actual 
applications- Much attention is given to construction techniques that insure 
a long mean time between failures. 

* Thermal capabilities: almost all prototype sensors, and all commercial prod- 
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ucts, cannot sense the thermal properties of a material. Further investigation 
was warranted to determine this sensing modality's potential usefulness. 

* Benchmark testing: many research and commercial devices have not been 
adequately tested malting it hard to determine their actual performance. 
By using a sensor test facility, detailed measurements are obtained t and the 
sensor '"s long term reliability established - 

* Computational support' high performance computer hardware and appro- 
priate software support must be provided foi the Eensor equipped hand. An. 
architecture that meets the long term needs of this project has been denned 
and tested. 

These issues arc fully discussed In subsequent chapters of this thesis. Finally, con- 
cluding remarks on work in progress to fully utilize the tools described is presented. 
The Utah-MIT hand equipped with contact sensors and a powerful computational 
architecture will he used to perform complex manipulatory operations that robots 
have never before been able to achieve 



Tactile 
Sensing 

Chapter 2 



The work presented within this chapter describes a tactile sensor for use with the 
Utah-MIT four fingered dexterous hand. Much of the development effort centered 
on Uolaliiig durable materials, and finding the construction and packaging tech- 
niques that permit mounting the sensor on the hand and reliably using it over an 
extended period of time. The following sec Lions review past work in tactile sensing 
and describe the prototype's design and performance in depth, 

2+1 Overview 

The potential usefulness of tactile serisora in robotics control applications is well 
documented in the literature [Overton and Williams 1961; Harmon 1963; Patio 
and De Rossi 1985]. However, the number of rabatic systems equipped with tactile 
sensors is surprisingly low. In fact., investigations oF how to process and effectively 
utilize such information are equally uncommon. The slow progress in this area is 
generally attributed to the lack of sen&ors that have the- Spatial resolution, sensi- 
tivity, repeatability, durability, and packaging required for robotics applications. 
The last two of these criterion create the most important and difficult problems in 
sensor design., and are often, ignored, 

J 3 
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In addition t the lack of suitable dexterous robots has slowed progress in tactile 
sensing auE)lications L To Fully exploit the power of a tactile sensor a manipulator 
must have the ability to reposition its fingers in three dimensions, as docs the 
Utah-MIT hand. The t&ctik sensor, of course* must he suitable for wee with the 
intended robot; if the sensor is too large or cannot conform to the mounting surface. 
available, it is of no use. 

Commonly cited applications for tactile sensing include parts orientation,, adap- 
tive grasping, shape recognition, slip detection, and texture discrimination [Har- 
mon 1062]. Each of these tasks is difficult,, if not impossible, to accomplish without 
the aid of touch feedback. Imagine performing a manipulatory task with your 
own hands. Covered with heavy gloves; the lack of tactile feedback in this situation 
severely hinders coordination. For these reasons, equipping the Utah-MIT hand 
with tactile sensors is considered essential, 

Both Binford |H>" J 2| and Harmon |lE)H2 have speculated on the performance 
needed for a robotics tactile system. Harmon's report presents the responses lo a 
questionnaire on touch sensing. The respondents were asked what properties an 
ideal tactile sensor should have, Spatial resolution was suggested to be in the range 
of 1 — 2 nun. The transduction matrix should have between £ X 10 and 1(1 X 20 
elements. Sensitivity ranges of 5 - 10 grains ucr tensor cell were given. Hysteresis 
Was Said to be "intolerable, 1 * yet skin like rubber coverings were desirable. 1 

Harmon estimates that a touch sensor for automotive assembly should have a 
12 x 12 array of force sensitive elements, or cells, in a 2.5 x 2.5 cm square area, 
giving an overall spatial resolution in the range of 1,6 mm. Hysteresis should be 
lees than 5 percent, and a scan rate of 100 nertu should be achieved. Finally^ he 
recommends a minimum force EcnsilivtLy of 40 grams uer sensor cell. 

These figures are often cited, though little attention has been given to their 
validity, In actuality, no suitable manipulator equipped with a touch sensor has 
been available to test them,. However, some general comments on sensor require- 
ments are warranted. To successfully evaluate the needs of a tactile sensor system, 
a detailed description of the planned tasks must be compiled. For example, if the 
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sensor is to be USCrl to delect the outline of small parts,, the spatial resolution must 
be suitably dense. On the other hand, if a sensor ia to be used to detect slippage, 
Spatial resolution is of less importance. Picking a scan rate of say, 100 Hertz, in- 
dependent of application does not seem reasonable either. Very high scan rates 
probably are needed for slip detection, while low scan rates would be suitable for 
small parts recondition. 

Since the body of literature on how to use tactile sensor data Is so small, selec- 
tion of the appropriate eensor requirements is difficult. As a compromise, it seems 
reasonable to make the device approximate a human's touch sensing capabilities. 
since our hand's sensor driven dexterous performance is so Rood. A brief review of 
human touch sensing capabilities is presented for this purpose. 

Humane have four different tactile sensors, each with their own specialised 
functions [Hollerbach IGS4], The Merkel and Ruffini receptors have some static 
touch response, while the Me-Lssner and Pacinian respond better to a changing 
stimulation. Two point discrimination is on the order of I mm, a reasonable goal 
to achieve for robotic devices- Texture detection is mostly an active process, where 
fingers are moved along a surface. In this case h the Market, Mcissner and Pacinian 
all contribute information. 

Each tactile receptor's response is controlled by both their structure and their 
placement within the Ekin [Phillips and Johnson 1981', The Mcissner's corpuscle 
responds to tangential stress., the Merkel responds to compressive strees indepen- 
dent of oriental ion j and Lhc Ruffini respond to directionaJ skin Stretch. Certain 
stimuli are detected by their mechanical interaction between the skin and the cor- 
puEcle n E response pattern. Merkel endings, for example, best detect the high stress 
patterns that an edge induces within the skin. From this we can conclude that the 
ultimate tactile sensor might require more than one transduction technology, along 
with an appropriate skin-like mounting medium. 

After selecting the sensor 1 s performance requirements, many engineering chal- 
lenges must then be addressed. The Space constraints involved with mounting a 
tactile sensor are often severe, and the environment under which it must operate Is 
commonly harsh. The active surface must withstand repeated contact with mate- 
rials, and probably requires a convenient method for replacement when it becomes 
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worn Of damaged. 1 The electronic and ^fcher dehcate portions oF the sensor must 
be protected from the environment, while simultaneously performing their sensing. 
function. Clearly^ special attention must be given to the sensor's overall packaging 
for these requirements to be met. 

Specifically, a number of design goals for the tactile sensor were established. 
These requirements come from both the special n^eds of the Utah-MIT hand, and 
from what are general ly felt to he desirable capabilities for a tactile sensor. The 
most Important specifications include' 

» An 8 x 8 array with under 2 mm cell center to center spacing: This requirement 
is motivated in part by the mechanorecaptor spacing of the human skin and in 
part by engineering constraints. Human tactile resolution is found to be on the 
order 1 mm [Phillips and Johnson 1 03 1 j , approximately the same as the actual 
mechanoreceptor spacing. To approximate, human performance ?. sfrsor ; p.i ■: i ■ r: 
clone to this level is desired. However, engineering considerations dictate a slightly 
larger spacing, to permit fabrication of a working and reliable sensor in a reasonable 
time frame. The 2 mm range was selected as a compromise between these two 
factors. 

• A sensing technology that permits mounting the device on the non-planar 
surfaces of the hand; Since the tactile sensor is intended for use with the Utah- 
MIT hand, and since the hand's ringers have curved surfaces, non-planar mounting 
is a critical deaijm goal. 

* A low pro [He package since space at the linger mounting sites is at a premium: 
The tactile sensor must not interfere with the overall dexterity of the hand, Bulky 
sensors would reduce the finger** effective workspace. 

# Small space requirements for the wiring and electronics needed at the fingertip 
aite, Again, the tactile sensor must fit- within the small space available at the hand's 
finger sites. 

• A compliant surface covering for increased prehension stability [Fearing and 
Ifollerbach 1384]. Recent work m gracing lias shown that the mechanical prop- 
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erties of the finger^ skin play an important role in. grasping operations. A soft 
material will Rive a plane contact,, instead of the point contact that would result 
From a hard material. This yield* greater grasp stability in part Tram the increased 
friction at the r.ontact *.:<:u. B ro c 1-; n r : \\9Bb\ proposes using a rhcological surFace 
that molds around the object being grasped, again to increase a grasp's natural 
stability,, 

One potential requirement that ha.i been omitted from, this East is the ability 
for the sensor to detect tangential force components. The sensor designed can only 
respond to fortes normal to its surface. This severs shortcoming is dictated by engi- 
neering considerations; ad dins tangential force detection was determined to be too 
complex: ta undertake at the current time. Unfortunately certain operations that 
tactile sensors should perform are harder to do using just normal force detection. 
For example, detecting slippage in the most general case requires comparison of 
the tangential force component with the normal force component made by contact 
point friction. 

2,2 Previous Work 

Many tactile sensor designs have been reported in the literature and a few have 
recently been made Into commercial products |Dario and De Rossi 1085; Ogorek 
1&8S; Harmon 1982]. However, none of the reported censors meet the previously de- 
scribed requirements for the Utah-MIT hand. Problems with packaging,, reliability, 
size, and sensitivity preclude their use. 

All tactile sensors must convert an applied force into a measurable electric 
signal. The design choice made Is in how that conversion process is to be done. 
The most common technologies employed are based on optics, reslstance> magnetic, 
or capacitance. This section discuses, several research and commercial sensons (see 
Table £.1) and briefly describes their functionality. 

S.S.1 Conductive Efaftomar Sensors 

Several experimental tactile sensors based on a material's resistive properties have 
been developed including those of Purbrlck [1981], Overton and Williams : 19Rl], 
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Table- 3-1+ Sv.mm.ary af re/tf.atch titd tcrmtnertial la c tih aensoTi. 



Year 


Device 


Size 


Spacing. 


Technology 


19S1 


Purfcrick 


8x3 


J i.5 mm 


resistive 


1982 


Hillis 


16 x 16 


A.7 mm 


resistive 


1982 


Raibert 


&)( 3 


1.6 mm 


VLSI 


1983 


Barry Wright 


16 x 16 


2,5 mm 


resistive 


1983 


Hatkwood 


7^7 


2 mm. 


magnetic 


1903 


Nomura 


15 x 15 


2 mm 


optica] 


15W4 


rtoic 


B X ll 


2.5 mm 


capaeitive 


1384 


Chun 


8 x & 


2 miii 


VLSI 


19S4 


Dario 


H >■ 1 o 


3 i'ii 


piezoelectric 


1984 


Jacobs- en 


1 cell 


20 TT17T1 


optical 


19S4 


Lord Corp 


1 (1 ■< 1 fi 


LB mm 


optical 


i im 


Schneiter 


2-1 X 35 


0,4 mm 


optic*] 


1985 


Tea Grotcnhuis 


16 x 8 


1.5 mm 


carbon fiber 


1985 


Petersen 


3x3 


1.6 mm 


VLSI 


1986 


Grahn 


3x4 


1 mm 


piezoelectric 



and Hill is |1982|. The Furbrick sensor uses conductive strips placed at right angles 
to printed circuit board traces, where tactile cells are formed at each intersection. 
As pressure Oil the r.r* n-r! 1 1 r.t. : .v n f:np increases, the contact resistance formed with 
the circuit board trace decreases. The device achieves a 3 mm centcr-to-Center 
cell spar-in R. The Overton and Williams sensor, based on conductive rubber plugs, 
achieves a 2.5 mm cell spacing. 

TTillia 1 device Is based on anisotropically conductive silicone rubber. This ma- 
terial is electrically conductive along one planar axis. As pressure ie applied to 
the top of the rubber, its conLact with a bottom circuit board is increased. By 
measuring the resulting resistance, the applied pressure at a particular point in trie 
array can be inferred. Hill is constructed a 16 K 1G array of sensor points,, with, 1 
mm center to center spacing 

Barry Wright Corporation's commercially available Seittoflex tactile system, has 
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an 16x16 amy with 2,5 mill center to center r.ell spacing. The conductive elastomer 
technology employed with in this sensor appears to be based on FurbricFs design. 

A few sensors utilizing carbon fibers have been pursued [Larcom.be 1976- Ten 
GroLenhuis and Moore 1985 1. Two sets of parallel carbon fiber layers ire placed 
perpendicular to each other. As pressure is applied on the grid, the junction 
resistance between the upper and lower fibers decrease. 

Unfortunately most of these sensors suffer from high hysteresis and law sensi- 
tivity. In addition, many have magnate cell spacing, though the fiillis sensor baa 
ackieved one oF the highest S pacings to date. 

£ S.S Solid Sta ts St nst>r$ 

Solid state VLSI based designs allow small transduction cells to be integrated with 
the amplification and scanning electronic, and with low level data analysis hard- 
ware. Haibert and Tanner |19S2; have developed a VLSI tactile sensing computer. 
The chip contains an. array of force sensing cells, each with their own processor. 
Two-dimensional convolutions and serialization of the sensor data are performed 
directly on the device. However, the force sensing cells are not based fully on VLSI, 
Instead they rely on a compressive resistive material placed over the package to 
transduce force changes to a measurable signal, 

The two most common fully VLSI based force transduction techniques utilize 
capacitive variations. ^Chun and Wise 198S] and piezoresistive changes [Wong and 
Van def Spiegel 10851, These sensore have silicone structures that respond to 
external Force stimuli. Th# latter principle measures the deflection of a small 
silicone structure with an embedded pressure sensitive resistor,, ar piezoresistor. 
With the former technique, a small diaphragm is constructed with an upper and 
lower plate. As force is applied, the diaphragm will contract, resulting in a change 
in capacitance between the plates proportional to the applied force, 

Transensnry Devices VLSI tactile sensor (Petersen et al. 19&5], now commer- 
cially available, uses piezoiesi stive strain gauge based elements spaced approxi- 
mately 1.6 mm apart, in a 3 X 3 array. Each cell has a iiurmal force range of to 
y()(] grams- A small pedestal placed on, each cell concentrates an applied force onto 
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the sensing site, improving the overall performance. 

While VLSI based designs shew great promise, ihcir current use in tactile sen- 
sors is limited by packaRing difficulties. The integrated devices themselves are fairly 
durable, but fragile bonding wires must be brought out from the chip. In addition,. 
VLSI sensors are currently fabricated only on flat surfaces,, prec-udinij their use on 
the curved portions oF the Utah-M!T hand's fingers. 

8.8.3 Piez&tUctrie Sttaort 

Dario et ai. [l&S't] describes a aenaor baaed on polyvinylidene liuride [PYFj], a 
material that has both piezoelectric and pyroelectric properties. Pressing a thin 
film Eheet of rVF 3 generates an electrical charge proportional to the applied force. 
In addition, the Dario tensor has a resistive based sensing layer to obtain static 
force measurement^ the. PVFi only responds to changes in the force stimulation. 
The pyroelectric properties oT the material can be used to measure a material's 
thermal properties. The device obtains, a 3 nun ccnter-to-centcr cell spacing in an 
8xlS array. 

Cralm and Astlc [106 6| describe a novel sensor based on ultrasonic pulse-echo 
ranging, A eheet of piezoelectric film is placed under a layer of silicone rubber. 
Electrodes are placed on the film at discrete points. To detect the applied pressure 
at a location of the array,, the piezoelectric film is excited. The vibration pulse is 
reflected off the silicone rubber surface,, and it 1 a return is detected by the film. The 
elapsed time between the pulse and the echo is proportional to the thickness of the 
silicone rubber at that point. While this sensor shows promise, the device has yet 
to made into a small array suitable for finger mounting. 

8.3.4 M<L$ntUt Based Sensors 

A magnetic ba*ed sensor has been proposed that extracts shear force as wcJl as 
surface normal force [Hacfcwood et al. 19&3'. An array of magnetic dipoles is 
embedded in an elastic medium, This rubber covering is placed over an array of 
magnetic field sensors fabricated in a silicone substrate. A pure normal force would 
increase all the magnetic field sensors around the elastic medium'a dipole evenly. 
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If a shear force were applied > the dipole would rotate and trans-late in the elastic 
medium. TJie ro Lali on and translation can then be measured by the variation in 
magnetic field in each of the cell's sensors. 

Sensors -of this type are interesting because of their ability to detect shear force, 
as well as surface normal forct i -formation. Most of the. sensors described in the 
literature are unable to do this. However, the Hack wood magnetic sensor has not 
worked out well; the magnetic effects being measured are ^uiie small, and hard to 
detect. In addition, the sensor is overly sensitive to extraneous magnetic fields and 
metallic objects. 

£.2.5 Optical Sensors 

Jacobsen et al. |l9Sd] discusses a fiber optical based tactile sensor that ut Rises a 
birefringent material. As force deflects tills materia!, its ability to pass polarized 
light is reduced. An optical sensor measures the returning light, and converts it to 
an electrical output proportional to Force. Unfortunately, only single tactile cells 
have been constructed and it is not dear if the technology can be extended to form 
an array. 

Two commercially produced optical sector are now available. An early Lord 
Corporation device (discussed in Ogorek 1985,. and in Dario 1985) with an optical 
transduction mechanism has an 8 sc 8 array with 7.6 mm cell spacing. As pressure 
on the sensor is increased, the deflection of its surface reduces the intensity of a 
light source. Lord's latest optoelectronic sensor achieves 1.8 mm cell spacing with 
a 10 x 16 array. The entire pad can be scanned in 3 milliseconds and its force 
capacity La 3 pounds. Begej Laboratories |Begej 1984] makes a fiber optic sensor 
with J.Q mm element spring. The system images the tactile output by projecting 
the optical fiber output onto a solid state camera. Both these sensors are too bulky 
for mounting on the Utah-MIT hand. 

Schneiter and Sheridan [1984]! describe a silicone rubber based Optical sensor, 
A reflective coating is applied to the underside of a silicone rubber sheet- A bundle 
of fibers, project light onto the sheet t and receive the reflected light back. Pressure 
applied to the silicone rubber modulates the reflected lights intensity, A video 
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camera is used to read the senior's output by imaging the fiber bundle. The device 
achieves a very hijdi spat la] resolution of 330 points pet Square Centimeter in an 
ir ray of 34 x 35 sensor elements. 

An advantage of optica] sensor designs is their relative inaensitivity to electrical 
interference. Since the force signal is propagated from the sensor site to detecting. 
electconics optical ly h noise Immunity is quite good, 

2.2.6 Capacitivc SenSaTi 

A <■::;.,!■ i"i-,.' |.mm-1 M-ii-::r mi-fis .icf. mi ;ijrilii'd "'nrcfi hy dntfiCtirg ■'■ i 1 1 : - - '..'■• ill thfl 
separation of two- electrically conductive plates. As the plate separation is reduced, 
the capacitance between them increases., 

Bole [1984] describes a prototype sensor with an K Y, H rell att?.\ t and 2.-5 mm 
eeilter-to-Center spacing. The technology described in his work Ls promising and was; 
selected as a starting point for the design used within ibis report. The remaining 
sections, of this chapter discuss eapacativc based tactile sensing, and then describe 
the sensor design, construction, and performance in depth . 

2.3 Design Issues 

This section discusses the tactile sensors design. The transduction principles, the 
fabrication processes, and the scanning electronics are covered in depth. Attention 
has bftfln given to describe both the final Eensor prototype and some intermediate 
devices. Thin approach gives a better feel for the difficulties encountered during 
the project, and better motivates, the choices made in the final design. 

The sensor described within this report is based on the work of Bole J19B4], 
Both sensors share the eapacitivc based force transduction principle, described in 
Bole's paper This work, however, investigates the use of improved cortEtr nation 
techniques to attain greater durability ar:d to permit mounting on curved surfaces, 
uses different scanning electronics for Improved performance and reduced size, has 
greater spatial resolution and sensitivity, and can be scanned at a higher rate. 
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2. S.J Transduction Primiptts 

Two parallel electrically conductive plates generate a capacitance proportional to 
their separation distance. If a compressible dielectric material is- placed between 
them, a force applied to the capacitor** top will reduce the plate separation dis- 
tance. The resulting change in capacitance can be uged to infer the applied i'on:^ 
This principle is the basis of the capacitive tactile sensor's force transduction mech- 
anism. 

An array of tapacitive cells is formed by sandwiching a dielectric layer between 
two sets of parallel conducting traces, with the lop etches perpendicular to the 
bottom ones. A capacitor is formed each time an upper trace Intersects a lower 
trace. To make an array of 64 force Sensing capacitors, -8 upper traces and. S lower 
traces are used, 

P. S.S Fabrication Ottaiis 

As previously mentioned, the basic operating principle For the tactile sensors is 
the measurement of an applied pressure by detecting a variation in the gap oF two 
parallel capacitive plates. Hence, the material between the two platea 5g a crm-ial 
component of the device; it forms both the elastic layer that compresses in response 
to pressure, and the dielectric layer that provides the capacitance between the two 
plates. 

Ideally, this material should compress linearly as force on it increases. This 
spring-like behavior is given by 

F - kAX, (4.i) 

where F is the applied force, k Is the effective spring constant,, and AX is the posi- 
tional change that the force produces. Having a material that closely approximates 
this equation makes it easy to translate the output of the sensor back to the applied 
force, since the detected capacitance will then vary in linear correspondence to the 
force, Thus, the material selected should have linear Compression over the range 
of pressures to be applied. 

The dielectric layer is composed of an electrically Insulating silicone rubber. 
Silicone rubber has the deairab'e flexibility and durability that the layer requires. 
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In addition, its dielectric constant Is approximately 4, which increases the overall 
performance of the device by increasing each cell's effective capacitance, 

Although the silken rubber 5s flexible, it does not have desirable continuum 
mechanical properties. Tn fact, it is largely incompressible when subjected to a 
uniform pressure applied over its surface. Since the tactile sensor detects an applied 
stimulus by measuring the resulting deformation profile that it generates, a solid 
object pushing uniformly into the pad will not excite a response. The following 
paragraphs examine this problem in more depth., and explain the solution that has 
been employed. 

To better understand the behavior of the rubber medium, consider it to be 
composed of small unit volume cubes with zyt coordinate frames. Assume that the 
jfi plane Is aligned with the material's surface* and Forces are applied along the x 
axis. The pressure applied to an axis of the cube is called a stress, A positional 
change resulting from the stress is called a strain, Stresses are related to straine 
by Hooked Law, where E is the modulus of elasticity. 

For the small cube^ Timoshentch and Goodier |l05l| gives ike relationship be- 
tween stresses and strains as 

* B = 1 (*■ - it*. + **)J E 2 - 2 ) 

where u is the applied stress and i is the resulting strain. Assuming the sensor 
uses a thin flat rubber sheet with Its bottom glued to a rigid mounting surface, 
the jr and s axis of the cube undergo hardly any positional change when a uniform 
pressure is applied to its surface, That ls„ the strains f„ and f x are close to zero. 
The tactile sensor measures, an applied pressure by detecting the positional change 
in the j direction,, which is given by £*. Using theEe conditions the resulting % strain 
can be computed . 

First* we obtain the y and (stresses. Since the following relationships approxi- 
mately hold 

** = i{^ -£[>. + **)) = o 
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which gives w 



and finally 

From this we Eee that 






". = ^ = ffx- [2.5] 



*" = E V* " 2~ *** + * B = °' 1 "- ( ' : ' 



This result indicates thai the tactile sensor would not detect the applied pressure 
at all, since no positional chacfe is induced in the i axis, Tn essence, there is no 

■"escape" path for the Tubber to take to relieve the applied pressure. The applied 
pressure is just converted into internal stresses. 

Even, if we relax the uniform pressure to the yz surface assumption, using a 
flat sheet of rubber causes problems. If a point pressure source is applied to its 
surface, complex positional changes in the £ direction will result, making it difficult 
to infer the actual contact profile. For example, materia] around the contact area 
will bulge out of the sensor's surface, 

To overcome this problem, we have formed the elastic-dielectric layer into a 
sheet with protruding round tab*.. As pressure Is applied to its top, the tabs 
compress, and the material expands to fill the surrounding air gaps. Figure 2.1 
diagrams this layer. In essence, the tabs permit the material to expand in the y 
and x directions and allow compression in the X direction. 

Now there will be no stress in the $z plane, since it Is all transformed into strain. 
This allows computation of the positional change in the i axis that the previous 
stimulus will induce: 

This indicates that the tactile sensor equipped with rubber tabs can detect the 
applied pressure. 

Phillips and Johnson (1981] discuss the mechanoreceptors in the human finger- 
They found that a p Jane stress assumption best fits flxperi mental receptor response 
data, A. plane stress model Indicates that all stress- is confined to the *y plane of 
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PigUTC 2-1: M&sUt'dirhttvic mattriai. Ituk&tr tabs have taen »rftfe</ J6 the tayti- t$ 
improve its cla&tomechanicat prvptrtiti, 



the skin. Escape occurs along the 2 axis. Adding rubber tabs to the tactile sensor 
makes it more closely approximate- tlio human skin, in this respect. 

In addition, the pressure sensitivity of the device is controlled by the properties 
of the elastic-dielectric material. The stlflnesa of the nibber, along with the height 
of the. pratrudiug tabs,, p]ay a role in the overall sensitivity and the pressure- ranges 
Lt:-:U am 1-bi- nl>::iini!ii. 

To obtain high sensitivity, dflsixahle For dcLeelmj; slippage ami light contact 
forces, a low stiffness dielectric should be selected, Unfortunately, this reduces the 
dynamic range of the device. That is, the maximum pressure that the sensor can 
handle before saturating is reduced. To overcome this^ it should be possible to 
form the tabs with two Layers of materials with different stiffnesses, as shown in 
Figure 2. 2, When a force is initially applied to the sensor, the Low stiffness portion 
of the tab compresses. As force is further increased, the higher stiffness material 
begins to compresSr For this scheme to work properly^ the low stiffness material 
miu>t go into non-linear saturation, when it no longer compresses with increasing 
pressure, The graph shown in Figure 2.2 diagrams its expected behavior. 

The dielectric is constructed SO each capacitor in the sensor array has a tab 
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Side View 




Compression Graph 




Applied Force 



Figure 2.2: Dual material dielectric layer. By forming the elastic-dielectric layer with 
two mattruti <?f varying stiffness, il shfiM fa passible to build a sentvr with iwtfi large 
dynamic range and high &r,n$ilivitp fo* small pressures. The frgph shams a plot of pressure 
against #vtt&U tab compression. 



between it. Since the dielectric constant of air 5a lower than that of rubber, it is 
beet to place the tabs at the capacitor junction sites. The current dielectric has a 
0.25 mm thick backing with tine tabs protruding out from 0.25 mm to 0.7& mm, 
iLfpujuimu on the desired force range. The tab diameter is L4 mm. Experimental 
results determined, that these values gave suitable performanc-e for an overall device 
sensitivity in the fct 200 grama per square millimeter range. 

To form an array of capacitors, electrical traces are attached to the dielectric's 
upper and lower surfaces, with the upper traces placed perpendicular to the lower 
ones, A capacitor is formed at each of the trace intersections. A thin layer of dec- 
trically insulating silicone rubber is placed around the device to provide electrical 
shielding. Finally, the sensor is covered with conductive silicone rubber to reduce 
external electrical interference. Figure 2.3 diagrams a erase section of the device. 
The next few paragraphs discuss this design in more depth. 

The current prototype bag & upper conductive traces and ■& lower conductive 
tracer forming 64 force sensitive capacitive cella. The scanning electronics dis- 



28 



Chapter £ Tactile Sinking 




Shielding 



Upper Traces 
Dielectric Material 



Lower Traces 
Mounting Surface 



Figure 2.3: Tactile sensor trass stdion. Frvm Ivp to b-pttttm; upper conductive trar.es, 
etaatie-dielettrie material, tvivsr conductive trices. The entire unit isesvtred wilk efc-Glricat 
fhieldiny. 



cussed in the following section read tmce. values off the amy by detecting each 
cell "a capacitance. 

The traces are made of an electrically conductive silicone rubber that bands la 
the dielectric layer. The parallel trace pattern js silk screened onto the dielectric 
layer, The lower dielectric aurfacc must first be made into a flat surface suitable 
for the traces. To do this„ a thin a heel of electrically insulating silicone rubber 
is honded to the bottom of the protruding tabs. The lower conductive traces are 
bonded onto this surface. Currently the traces are 1,27 mm wide, with 0.63 mm 
gap between adjacent rows, Hcnee., the capacitor plate area, is 1,27 square mm, 
and the center-to-center cell separation is 1.9 mm. 

The sensor must be shielded from stray electrical interference. Without proper 
shielding, the small capacitances that are to be detected at the trace junctions 
would be swamped by parasitic affects. To do this, the sensor packag* Is covered 
With an electrically conductive material r Before this can be done, however, the 



§B,8 Design Issues 



29 



0.63 mm 
1 .27 mm 



Lower Trace 



Upper Trace 




Amp 



Amp 



Circuit Board 



Figure 3 A: ffigtotypt tactile -sen-scr packaging. The dielectric material fa m-oitftierf aula 
a printed circuit board. The board pro vidua the fowcr traces, 



upper and lower trace* must be coveted with an thin insulating rubber layer, and 
wires connected to the traces must he brought out from the package. 

For initial testing of the device, the upper conductive traces were silk screened 
to the dielectric layer and mounted onto a, printed circuit board (Figure 2.4). The 
hoard provides the lower conductive traces. The sensor was then, covered with an 
electrically insulating layer, and finally an elec trie ally conductive layer to provide 
shielding. Photographs of various parts of the tactile sensor are shown in Figure 
2.5, 

The materials chosen for the various layers of the sensor were often hard to come 
by, and had complex interactions when Layered together to form the overall devjee. 
For example, placing certain silicone rubbers onto each other often interfered with 
their chemical curing process, preventing one of the layers front hardening. In addi- 
tion t not alt silicone rubbers bond with each other to being with. Tfiaki Garabieta, 
a ataJI member at the MIT Artificial Intelligence Laboratory,, played a crucial role 
in locating these materials and In constructing the sensor itself. His tremendous 
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Figure 2.5: Pfeeipgrapfcs o/ lottilc acntor components. Top from, lift: printed circuit 

l>4tirtt t ditteetric tayr.r fi^uiKnf /roi7i In A ^"(ftf, ^i^le^lTtc JV+yer an J ttpprr rondncii^f truest, 

Bottom from left: stmcr mounted onto printed circuit board with tra.ee connections exposed, 
back view of tzmsor and detection electronic*. 

skill and craftsmanship made it & reality, 

S'.S.S Detection Electronics 



Before discussing the detection electronics, it is useful to estimate the capacitance 
of a senior cell. Hopefully, ita magnitude will be lajge enough to permit detection 
with, relatively simple electronic^ keeping the size and cost of the stnEor within 
reasonable liniils. 
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Figure 2.fii Ctpteiiancc arrsj schematic diagram, 
The capacitance of two parallel plates,, ill electrostatic units, iR given by: 



C = 



ivd 1 



(2.8} 



whore n is the dielectric constant uF ihc separation material, and d and A are 
the separation d la Lance and area of trie two plates, respectively. If we assume 
d = 0.025 cm, A = 0.16 cm 5 , a dielectric constant of 4, and that the farad = 9x 10' 1 
electrostatic units.,, the nominal capacitance for a force cell is approximately 0.2 pf. 
Experimentally, the value was found to be closer to 0.5 pf, possibly due to a higher 
than expected dielectric constant. This is large enough to detect if ample electrical 
shielding is provided to reduce external stray capacitance. 

Various techniques for measuring capacitance exist. Hgwuvlt, cloI all of them 
are apjjlkiiblu fur this sensor, since constraints exist on the interconnections be- 
tween the detection electronics and the eapacttivc cells. This occurs because wires 
cannot be connected to both terminals of each force sensing capacitor. Thus, be- 
fore considering how to measure the capacitance of thE sensor's array of cells, its 
effective schematic diagram must be preEented. 

Recall the hasic deRign of the sensor. Its upper layer contains tows, of parallel 
conductors, placed perpendicular to a lower layer of parallel conductors. The two 
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layers are separated by the elastic-dielectric material. At each intersection of an 
upper trace and a lower trace, a capacitor is formed.. The overall interconnection 
pattern results in the schematic diagram shown in Figure 2,6, 

Tlii:; ii i !<.-::: nji :j<<: ti o: i jJi-.'.UTJi i nmtraiii:; the m. I iui [_*■>: cu-aita l>lc for detecting each 
cell's capacitance. One can readily see that each small capacitor cannot be con- 
nected Id a detector alone. In fad, the best that can be done is to select the row 
tine and column line corresponding to the cell. The other cells connected to the 
selected row and column will affect the output value. The detection electronics 
must minimize the effects of these other cells. In effect, the detection electronics 
must isolate each cell in the array from all others, when taking its reading. 

Before discussing the actual design chosen for the sensory a review of several 
alternative methods may lie instructive. Figure 2.7 diagrams several approaches 
for measuring capacitance, some of which are not applicable to the sensor, but are 
interesting none the less. 

Circuit A diagrams a bridge detection scheme. Here s a time varying signal is ap- 
plied to the circuit inputs, As the capacitor** value varies, the effective impedance 
of one side of the bridge chanKes, affecting the voltage between V a and V t . A differ- 
ential amplifier can be used to detect this difference. The output of this amplifier is 
proportional to the capacitance being detected. Since a differential signal is being 
detected and amplified, this scheme has the potential for highly accurate measure- 
ments. Unfortunately, it cannot he used with the tactile sensor, since Forming the 
bridge requires access to both terminals of a celt's capacitor. 

Circuit B uses the the resulting time constant between the unknown capaci- 
tor and a reference resistor, When a unit pulse is applied to the capacitor h the 
amplifier's output will exponentially decaj r with a RC time constant. Another cir- 
cuit, not shown in the schematic, times the decay and then computes the value oF 
C Since C is quite small, the timing circuit required must be fast and sensitive, 
complicating the detection scheme's design. 

Another approach to measuring changing capacitance is ba&Ed on charge con- 
servation. To understand how it works, the constituent equation for a capacitor 
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Figure 2.T: Methods for deteetin$ cap* ata-Astr 
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must be presented. The amount of charge a capacitor can store is given by, 

Q = CV, (3.9J 

where (5 is charge, C is capacitance,, arid V is the voltage difference between the ca- 
pacitor's plates, As the distance between the plates is changed, the charge changes: 

Here, a current ffow of t is induced as the capacitance changes. The voltage ia 
assumed to he constant. 

This scheme is realized in Circuit C ( Figure 2.7). Here + C Mtt varies over time 
and C ri j is a fixed reference, Since <7«j| and G tI f are connected! the- charge on their 
plates must be the same: 

Vin dt ~ dt~ CnI ^dT- f2ll) 

Equation 2,11 hotds hecause the input impedance of an operational amplifier can 
be made high enough to neglect the current thai, would flow into its terminal. 
So, whenever the input capacitor's, value changes, a proportional change in the 
output voltage is induced. Unfortunately, this method does not work well with 
leaky capacitors, as the ones forming the tactile sensor ate likely to be, Over time, 
charge will actually leak between the capacitor plates, changing the output voltage 
appreciably. 

The detection method chosen for the tactile sensor is also based on circuit C. 
It's operation is similar to the previous scheme, but overcomes the effects of leaky 
capacitive cells- Now the input signal V in is varied over time. If Wt- assume C is 
fixed, acd tUaL V varies over time, differentiating Equation 2-9 gives 

Now, however, the current flow i varies continuously, since the input signal is not 
constant. Since the junction charge Is constantly changing, it is much less sensitive 
to capacitance leakage than the previous scheme. So, if V in = sinwfc, the circuit 
output is given by: 

K™. = -Vi*£K (2.13) 
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where CV,/ is the feedback capacitor selected to give an appropriate gain. 

Equation 2.13 shows that the output of the amplifier is just a modulated version 
of the input signal. To measure the capacitance of C, ? ,\ { , the variation in amplitude 
of the sinusoidal output waveform Ls detected. First, the output waveform is pre- 
cision rectified. In essence,, its absolute value is obtained. Next, additional gain 
is applied, and low pass filtering converts the lime varying waveform to a direct 
current signal with magnitude proportional to the root mean square voltage of 
the original signal, Conveniently, root mean square detector chips can be used to 
perform most of the detection e'e.ctromcji, greatly reducing the circuit's complexity. 

To better understand the sensor's performance-, and to select the operating, fre- 
quency for the input waveform, a more detailed analysis Is needed. The frequency 
of the input signal affects the -reactance (generalised resistance) of a capacitor. The 
reactance of a capacitor is given by: 

Z = J£c> »•") 

where ui is the input signal frequency^ From this equation We see that the higher the 
input frequency; the lees reactance the capacitor has, and the greater the current 
flow through it. Since C M u is on the order of ].D pf, a relatively high frequency 
le needed to obtain even a small current. Assuming an operation frequency of 
100K hertz, the capacitor has an effective resistance of 10 megaohms. Since the 
operational ainplilier input resistance should be large relative to this, an FET input 
device and a high frequency signal should be used. 

The preceding assumption of infinite operational amplifier gain must be relaxed 
to fully understand the performance of this detection, scheme. Since an amplifier 
has a finite gain- bandwidth product high frequency input signals will result in 
significantly lower amplification. If this iE the case T Equation 2-13 will no longer 
hold. 

It is now clear that input signal frequency cannot be increased at will. It will 
eventually deteriorate the amplifiers performance. On the other hand, the input 
frequency cannot be too low, or not enough current will flow though the input 
capacitor. To fully understand this tradeoff, however h we must consider the entire 
sensor in our model- 
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Column Select 



Figure 3*8-: Capacitance Array scsitrttn-j electronics schematic diajfata. 



The effective schematic of the capatilivc array is show in Figure 2,o\ A scan 
of the array should measure the cftpaci tance of each of these Cells. The scanning 
electronics must read each cell Individually, and must overcome the cross- talk that 
the interconnect pattern might cause. To do this, an amplifier Is connected to each 
of the scilslut^ rows, while an input signal is applied to one column at a, time [Figure 
2.S], in a sequential fashion. Hopefully, the row amplifier outputs Will COrrCBUoud 
to the capacitance of the selected column's cells. 

Il J''i g.. ri. 1 2.fJ v. hlou- dcl.riLlrfL u;r:dcl or" :)\c armor's Flpcrmiika is pn-M/uU :l , 
Here, the 7 capactttve cells in the column that arc not selected are shown connected 
to the amplifier's negative input, and are laheled C^ r The amplifier's negative Input 
lb modeled as a rcsis'.or to ground, to indicate that some current flows into it, The 
resistor Jk*u models the sensed capacitor's leakage. Applying KirehhofTVa current 
law to the junction at the amplifier's negative input gives. 



-n„ , » , » , »_-v„ 



■,-::. 



7, 



■y 



?*T*i 



(2.15) 



where & is the gain of the amplifier at the particular operating frequency, Z^ is 
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Figure 2.9? Detailed mo4d of the tattiU tewr'* scanning tltctr$me f , 

the effective impedance of the parallel combination of the other capacitors on the 
Eelected column^ Z^ is the impedance of the amplifier 1 ? negative input, and Z itfl is 
the impedance of the sensed capacitor and its plate leakage. The impedances are 
given by: 

Z u = ir,j 



■"«p "op 



(2.16) 



Solving for V^ gives 



juC< eJl R teil + 1 



.i. 



Since FET input amplifier are used* we call assume fl^, is very large: 



(3,17) 



V qiJ = -K„C 



jwJ^fC^/G + C v -C r<J I- C e , H ) + 1 ' 



[2.18) 



Under ideal conditions, where both G and R< tti are very large, Equation 2.16 
gives the desired result: 

Gitti (2-19) 



V«,i = -V t 
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Figure 2rl0; Graph vfthc Twt'te L^MAv'f (Jra&stalit Immunity with reaped to amplifier 
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The effects of plate leakage can be cstajMined using Equation 2.18. For targe gain. 

G, the magnitude of V^ % IS 



*bu( — *Jm 
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(2,20) 



Errors in the output signal occur when j?«j[ is large QT W b small. Hence choosing 
a targe value for w minimizes, leakage affects. 

If we assume the drive frequency is high enough to ensure low plate leakage, 
Equation 2.13 gives us 



v ^ = -\% 



\2.-n) 



C n jG + C u — G„f + Cpdt 
Ideally, V nui should be independent of the capacitors that are not selected (C^\. If 
we assume that C iel \ has a capacitance of 1.0 pf t and C rt f has a capacitance af 1.0 
pf. and ^ n has amplitude 10, V^ shoutd be 10, Any variation from this value will 
result in an erroneous measurement of the celPs capacitance. Equation 2.21 can he 
used to determine the gain required for this to be the case. 

The graph in Figure 2. 10 shoWl the effects of G and C„ on snnsor output, as 
obtained from Equation J i.2l. SenEor output Is plotted against increasing gain. 
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Ideally, the output should be 10, and any deviation from that line La undesirable. 
Several curves are plotted for different values of C ai Since lis actual value depends. 
dr the force distribution an the sensor pad. The graph indicates, that for gain over 
approximately 200, adequate performance is obtained. This limits the operating 
frequency of the inpyt signal to the Bain-bandwidth product of the amplifier divided 
by 2DD, Using this criterion, a driving signal of 200K hertz was selected for the 
prototype sensor, 

S.&.4 Design Process Summary 

The device described in the previous section* required several design iterations 
before it resulted in a suitable sensor. In fact, the initial prototypes did not work 
at alL A brief review of some of the earlier attempts and failures at making the 
capacitive sensor will emphasize the most important features ill the final device, 

Vtrswn one, 1 the lower traces were etched onto a printed circuit hoard. Con- 
ductive paint was used to silk screen the upper traces onto thin rubber materials. 
Unfortunately, the electrically conductive rubber reacted with the elastic-dielectric 
layers that it was being applied to, and lost its conductivity. After Several attempts, 
it was decided to apply the conductive paint onto a thin mylar sheet. This worked, 
tut unfortunately mylar is not a flexible material. However, we used this sheet in 
the initial prototypes in lieu of anything else that worked. The elastic-dielectric 
materials used were very thin sheets of rubber, The motivation for this was that 
the junction capacitance would be maximized by a small plate gap. The electronics 
detection circuitry was Fabricated on a wire wrap board, and the sensor was located 
near the electrical detection components. This device did not work at all. 

VeTtiontwo: evaluation of version one^s failure indicated that too little attention 
had been given to parasiLic capacitances. The detection electronics were located 
far from the capacitive array and the sensor itself was not enclosed within adequate 
electrical shielding. The next prototype was huilt with onboard amplifiers, placed 
in close proximity to the array, Surface mounted components were used to minimize 
their Eize r This worked, although the performance was not adequate. Performance 
problems included large crosstalk beLween sensor rows and poor response to an 
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applied force. 

Version three: small ground traces Were placed between the rows to reduce the 
cross talk and rubber tabs were added to the elastic-dielectric layer to increase its 
compressibility. In addiiion, extensive electrical shielding was added to the entire 
package. The performance was now satisfactory,, approaching th e established design 
goal. 

Version four: the mylar sheet with the upper conductive traces had to be elim- 
inated- This layer caused non linearities in the sensor's force output and reduced 
overall accuracy. Since a smalt, variable amount of air was trapped between tEie my- 
lar sheet and the etastlc-dielcc trie layer,, the actual distanr.e between the capacitor's 
upper and lowe.r plates was hard to control, After a lengthy search of materials, 
an electrically conductive silicone elastomer that hounded to the elastic-dielectric 
layer was found. This resulted in the device described i:j this chapter. 

2.4 Performance Results 

A series of experiments was performed to quantify the tactile sensor's performance. 
The set of experiments selected identify such criteria as pressure sensitivity, shape 
discrimination, repeatability, stability, hysteresis, and interference immunity. Be- 
fore beginning to review the experimental results, a brief digression on the sensor 
evaluation process is presented. 

£.^.J Quantifying a Sowar's Performance 

It is easy to compare the performp.rrfi of two Stereo receivers. Over time, people 
have agreed upon a set of standard metrics that allow contrasting different units. 
Such figures as "'power out-put* and "harmonic distortion 31 are commonly used, 
Without a reason ahle and agreed upon convention for these comparisons, it would 
be difficult to make relative performance statements about different models. 

Tactile sensor literature is plagued by a lack of evaluation metrics. Because 
of this, it is often hard to tell if a new sensor is really an advance over previous 
efforts. In fact, there is little agreement on any performance evaluation standards 
at all. For example, no standard metric for reporting a tactile sensor's pressure 
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sensitivity exists. When pressure is applied to a pad. should it be applied as a 
point source, or over a large area, or both? To make matte™ worse, researchers 
often fail to Indicate how a particular test was applied, and report, for example, 
die sensor 1 !, output for a particular force, giving no indication of how that force 
was distributed over the array. 

About the only metric that is consistently used is the number of tactile sensor 
cells in the array, However* this figure is practically meaningless;. Ostensibly* the 
figure is reported as some indication of the overall spatial resolution of the device. 
In reality* the spatial resolution is a complicated function of the cell density, the 
covering materials-, and the scanning electronics. It would be useful to have an 
experimentally determined figure that would overcome this problem, and convey 
more useful information about the sensor^ capabilities. 

The psychological literature can provide a useful starting point for quantifying 
sensor performance, Phillips and Johnson's [1981] have studied human touch sens- 
ing extensively using a number of interesting tests, Specifically,, they characterize 
two-point discrimination, gap detection, grating resolution, and letter recognition. 
While some of their procedures are specific to human subjects, their methodology 
Ie of general use for the development of tactile sensor test standards, In addition;, 
use of these tests would allow r,OTi:r:?.ngon of tactile sensors to a human's touch ca- 
pabilities. Perhaps the most important point to be learned from their work is that 
the design of touch sensing experiments must be done carefully. Since complicated 
mechanical interactions between the skin, the mechanoreceptors 1 and the testing 
apparatus occur, the set of experiments performed must be well thought out for 
their results to be meaningful. 

The following sections prcseELt not only a performance evaluation of the sensor, 
but discuss the significance of the tests themselves. Hopefully they provide a 
concrete picture of the tactile sensor's capabilities. Direct application of the Phillips 
and Johnson studies has been omitted due to time considerations. 

To gather more accurate and complete data, a tactile sensor tester was devel- 
oped. The device, diagrammed in Figure 2>11, can apply a force accurate I y at any 
point on a tactile sensor pad. A stepper motor controlled ry positioning table moves 
the pad 1 and a stepper motor controlled linear slide mounted perpendicular to the 
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Figure 2.11: Twlit* **tutit ttttt* 



table applies- the force. The three motors are under complete computer control. If 
a probe lip Were mounted directly on the Z axis, a small pos-ilion changes would 
product a large force increase into the eeilsot since I tic slide advances a relatively 
Jarfjs distances per step. In effect t the granularity of forces that could be applied 
would not be adequate. To overcome this, a small Imeitr slidi; is mounted onto the 
tester's a &X18 and the probe ls attached to the outer side of the slide, A spring is 
connected between the t asU and the top of the probe. As the probe. Ls pressed into 
the sensor pad, the spring coiopreases 1 and the applied force increases. The linear 
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slide keeps the position of the probe aligned with the axis. To accurately measure 
the fores being applied, the probe tip is mounted onto a load cell. The Load cell's 
force output is sent to an analog to digital converter for computer processing, The 
experiments described in the following sec Lions were conducted using tbLe device, 

£.£.& Pressure Sfn$itivit]f 

One of the mast important performance criterion to establish Is the sensor's pres- 
sure sensitivity. In general, the sensor's response is affected by the applied force 
and the force distribution. Unfortunately, the response jicr force unit area is not 
invariant over the applied area. That is> as the area of an applied stimulus of 
constant pressure is changed,, the sensor's output also changes. 

The response variation due to stimulus size is due to both mechanical and elec- 
trical properties. If the sensor were composed of discrete force sensing elements 
that have no connection to each other there would be no siting affect. However, 
since moat sensors have interconnecting components in them (an elastomcric cov- 
ering, for example}, the mechanical connections becomes a factor. The sensor's 
scanning elecironics also play a role in its response. Hopefully the electronics can 
read a cell without ambiguity. In some sensors, however, the values of neighboring 
cells can have effects on each Other. 

The pressure sensitivity measurements obtained do not indicate the precision 
of the sensor. Instead, they attempt to capture the range of stimuli that the sensor 
can detect.. Tbis is useful for evaluating such factors as how light a touch can the 
device perceive,, or how much pressure forces it into saturation. Since a tactile 
sensor is not necessarily used as a precise measuring device, this distinction is 
warranted. 

To test the sensor's pressure response, different probe tips with various contact 
Surface areas were pushed into the pad. When a uniform pressure was applied, the 
sensor response was largely invariant over probe tip size. The rubber tabs in the 
elastic-dielectric material are responsible for this desirable behavior. 

Figure 2.12 show the response of 6 tactile celiE subjected to an applied force 
from to 150 pains. A probe tip with 1.5 mm square area was used. The top 
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graph sbqwg the response of S cells along the same column of the sensor, while the 
bottom shows the response of 3 celts along the same row, Each rriw shares the 
same detection amplifier and each column shares the same applied input voltage. 
These plots show that the slope of force response is fairly constant in aj] cases, 
though Lhe output offsets vary. Since the variation ill cell Outputs are similar for 
U1t.i1 r, 1 1 1- riv.v c iiot: nr.d '.he r o! 11 m -1 esse-, ilu conclusions :?.n hf-. 'CMrJiud utl w::ar. 
sources contribute most heavily to the output variation. 

Hysteresis plagues most sensory particularly elastomerlc based devices Eiich A3 the 
capacitive array. The problem is exhibited by measuring the sensor Output as a 
force probe is pressed arid then released from its surface. The output while the 
probe force is increasing differs from the output while the force is decreasing. Tn 
essence, the rubber dielectric expands at a slower rate than it contracts, when 
subjected to the same force, ThkS is clearly a problem if the sensor is being used 
to accurately measure in applied force, since it introduces output uncertainty. 

In actuality, hysteresis in tactile sensorE may not prove to be as major problem 
as some researcher* have suggested. Human skin displays substantial hysteresis! yet 
our UC-Jk- sensing ability is well e^'-ipped to handle ron plex manipulatory tasks. 
In addition, a robotic system can compensate for hysteresis hy recording, the time 
history of the manipulator motion. Since the robot knows if its motion is causing 
increasing or decreasing force into an object, it can select the appropriate half of 
the hysteresis curve to translate sensor output into force, Even more importantly, 
hysteresis is probably unavoidable since tactile sensors must have elastomerlc cov- 
erings. Previous discussion has established why a soft covering is so important. 

To examine the sensor's hysteresis, a probe was pushed into the center of one 
cet] r The sensor's output was sampled while the force was varied from la ISO 
grants, and then hack to grams. Since the speed at which the probe is applied 
and then retracted affects lhe level of hysteresis, the force range was covered at 
several different rates. The plots show 11 in Figure 2.]^ diagram the results of two of 
the trials. The upper graph corresponds to a force applied over a 2 minute interval 
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while I he lower graph was obtained ovtir H Trlrr.rt.PS As expected, the Longer L'.,ii^i.c: 
time reduces the hysteresis, 

£.1.^ A-feasurerrKni i?epeata6tJif.y 

Tests were performed to determine how accurately a sensor can measure an applied 
force. The tester probe was poked into a eapacitive cell a number of limes, and 
the sensor's output was recorded. The output variance was used to compute the 
number of significant bits of force data that the computer was receiving from (he 
pad. Repeated trials found that independent of hysteresis, & bits of data were 
obtained. The actual uncertainty is larger if the force's time history is unknown, 
since hysteresis is on the order of 5 percent of the full scale reading. 

&4-S Sp&tid Selectivity 



ive 



Tilt spatial resolution of the sensor is a function of the Spacing between capacii 
cell centers and the elastomerk properties of the dielectric arid protective coverings, 
For a sensor chat records just surFace normal force j a point source should only be 
detected by the one or more cells directly in contact with the stimuli; spreading 
or blurring to adjacent cells should be minimal. Obviously, having a sharp sensor 
response will give more detail in tactile force- outlines of probed objects. In some 
cases, however, it may be useful to propagate strains between adjacent sensor sites. 
Fearing and Hollerbacb |19fi4| theoretically show how strain sensors placed below 
a surface can extract the angle of inclination, location, and magnitude of a load 
line. 

To measure the spatial selectivity of the sensor pad the tactile tester was pro- 
grammed to step linearly across the sensor pad and to apply a uniform force at each 
location. The probe was advanced at 0.1 mm Intervals and applied 1W grams force 
at each point. One would expect that a cell would respond best to a force applied 
directly at its center. As the probe moves further away, a drop in output should 
be noticed, The receptive field of each cell is affected mostly by the mechanical 
properties of the rubber clastic-dielectric layer with the tabs helping to localize a 
cells response. 
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The plots shown in Figure 214 summarize the results of this test. The curves 

show the response of 3 adjacent sensor Cells as a probe is linearly stepped across 
them, The peaks of the plots are spaced approximately 2 mm apart as expected, 
since this is the array's center-ta-eenter spacing. Xotice that there is some response 
overlap between adjacent cells. That is, when probing on a ceil, the neighboring 
cell will show some response as well. This behavior is desirable since it avoids the 
dead zones between celis that wonld otherwise result. 

£,4.6 Shape Discrimination 

The shape oF an object can be obtained by pressing the tactile sensor against 
it, and recording the resultant force profile. In cases ■where visual inspection is 
impossible, such as when a manipulator end-effector obscures the view, this; is 
especially desirable. The spatial resolution results of the previous section indicate 
that the sensor's shape discrimination ability should be good. To verify this, small 
objects were pressed against the tactile pad, and the force outputs were recorded. 
Since shape recognition utili?es. at] (34 tactile cells, a calibration procedure must 
be employed to normalise the array's response. That is, each cell should read the 
same value when equal forces are applied to them. Variations In cell Output with 
an applied Force occur for several reasons, A cell's force response is related to the 
compressibility oF the elastic-dielectric material at its location. Small variations in 
the silicone rubber** properties cause differences in compressibility at different pad 
locations. In addition, the scanning electronics themselves have small component 
variations, inducing differences in the force output of the cells. 

To calibrate the sensor the tactile tester apparatus was employed. The tester 
was programmed to probe at the center of each tactile cell with a number of 
different Forces. The ac'.ual applied Force and the cell's output were recorded for 
each measurement, A least squares procedure was used to lit a straight line to these 
data points. Table 2.% shows the calibration data for one of the sensor pad* used to 
record the tactile images shown in this section. The slope and 1CT0 force intercept 
for each cell is given. Since a preceding section showed that the sensor's force 
response is linear, fitting the data points, to a straight line is considered adequate. 
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Tabic 2,2: Tactile sensor t&tibt&li&n. data The slope and intercept a/ {ft? cell cur-piti to 
force output curve. Tfte ujjjstt ^ufoc in each box is the tartot 1 * tttvpc. The lower valu/r i* 
(it enn)* J j( zflrq farce intercept. 
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The actual force output is obtained from a sensor's cell output from 



m 



= /. 



aut. 



(2-22) 



where m is the curve's slope, * is the zero force in.tere*r>t + c^t is the raw sensor 
output, and /*u/ Is the normalised force. Notice that the values in each column 
of Table 2.2 are relatively constant. This occurs because each column lias its 
own amplification electronics. Evidently the variations in the amplifier's electronic 
components contribute heavily to the calibration difference in force output. 

Figures 2.15 throufih 2.23 show tactile force images. The data is displayed using 
three dimensional bar ploli. The heifiht of eiir.h r>f the 8 X 8 bars corresponds to 
the cell's force output. Figures 2.15, 2.16, and 2. 17 show force images of Straight 
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Figure 2,15: Tactile image* c-f edges. Tap: aJijnp rf slightly off boriiotitiLt axi>. Bvitomi 
aligned directly on vtH-ieal axis. 
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Figure 2rlG: TacliU imajta of r4g**- Top: aliened on a diagonal uaia. ^|(tnn; nHgntd 
slightly &ff ha tix&VLt af n;™. 
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Figure 2.1^T: Tactile image* of tdaes. Top: aligned on diagonal iiis, preBaed with large' 
fortt, B<?tt<?m; aligned on diagonal axis r prmncd with small force. 
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Top View 



Side View 
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Figure 2. IS; Tactile ima'je t.<f iitlcgrnted circuit socket. Top: diagram &f a&tktt. Bolto-m: 
imact #/ socket. 
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Figure 2.10r TattiU i"jtiaj« of inteorattd circuit iackr-i. Top: aligned en diagonal axis. 
Bottom: aligned ok opposite diagonal axis. 
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Side View 





l-'i^nre 2.2(1: Tactile image af part with tu>& e4$£*- Top: diagtarn of part. Bottom: side 
incur image of part. 
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Figure 2.21: Tnri.Hr. TWajr-s of part with twn edgta. T«p: rzJijnpd #n vtriicai (tits. 
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Figure 2.22: Tactile images of bolt and washtr. Top: holt. Bottom: mo&ktr. 
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Top View 




Side View 





Figure 2.21: Ttir.tilt; image <tf a Melex tuna^Cor. Tvp; diagram of somttctpr. Boltotn: 
tactile irnaje, 
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edges pushed into the sensor pad at different angles. Figures 2.18 and 2.19 show 
images of an integrated circuit socket. Figure 2. 20 and 2.21 show images of a fairly 
complex part with two parallel edges, one thicker than the other. The actual gap 
between the edges is. approximately 3 mm n corresponding to the 1 pixel gap shown 
in the image (sensor cells are placed 1.9 rnm center- to-center). Figure 'L'l'l show 
images of a bolt and a washer. Finally, Figure 2.23 shows the profile of a 6 pin 
moles connector. In all cases the variations in pixel height along an object's edges 
eome from variations in the pressure distribution as the object was pushed into the 
sensor pad, No special provisions were taken to insure that a uniform pressure was 
being applied over the part. 

£.4-7 Interference Immunity 

It is important to insure that the tactile sensor will function in a variety of working 
environments. One problem with capacitive sen sing frequently cited in the litera- 
ture is their sensitivity to external interference. In essence,, parasitic capacitance 
can interfere with the sensor's operation. To overcome this prohlem, the device 
constructed is extensively shielded i the entire sensor is enclosed within a grounded 
chamber- 
To test the array's response to external stimuli, a series of objects were placed 
near it s without making direct contact to its surface. The sensor output was- moni- 
tored for any detectable variations due to these external perturbations. None could 
be found. The device's shxMiue; iideqciatcly protects it from external interference. 

2.5 Overall Device Evaluation 

The beginning of this section discussed the lack of a set of common benchmarks 
for sensor comparison. This, of course, makes it hard for the results in this section 
to be compared with other works. However, a general discussion of how this tactile 
sensor compares with previous works is warranted, 

The sensor has achieved significant advances over Bole's prototype tactile sen- 
sor. The cell center-to-center spacing has been reduced from 2-5 mm to 1-9 mm, a 
32 percent reduction. The technology employed within the sensor should support a 
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further reduction of cell spacing to the level of 1 mm. Of equal importance are the 
improvements to the sensors packaging. Tin? fully shielded integral silicone rubber 
package gives the device increased sensitivity and reliability, and permit mounting 
on curved surfaces. The use of tabs in the ail Leone rubber elastic-dielectric layer 
give- much more flexibility in selecting pressure sensitivity than the nylon stocking 
used in Boie h s sensor. The scanning electronics have been redesigned to improve 
their performance a-d reduce thflir size, to facilitate mounting the sensor in smaller 
spaces such its oil the lingers of the Utah-MIT hand. Finally, the sensor can be 
scanned faster than Boie 1 ^ at a rate of 500 frames per second. 

The primary design goal of making a tactile sensor suitable Tor use with the 
Utah-MIT hand his been achieved. The sensor can be mounted on the Curved finder 
surfaces, and the eiie of the electronics is within the space available at the fingers. 
The cell spacing of the current prototype 13 close to the 1.5 nun. center-to-center 
spacing that was considered desirable. 

Unfortunately, the sensor only responds to surface normal force, and not tan- 
gential force components. This will complicate certain tusks, such as slip detection. 
The sensor's hysteresis might also be a problem since it reduces the overall sen- 
sitivity of the device. The hysteresis problem may be overcome bv employing a 
different elastic-dielectric materia). Shear force detection, however, does not seem 
possible using ihiii sensing technology. 

The sensor's performance approaches some of Harmon*s goals. Its cell spacing 
approaches the suggested I. h mm range, its hysteresis is near the suggested 10 
percent level, and its force sensitivity exceeds the 40 grams per millinictcr recom- 
mendation. 

Future improvements planned for the device include a reduction in cell size to 
the level of ].2 :v:\: t:r.n\vz-t.a-cr.-'.(\T Kji.ifHg, increasing Uie army sv/.r-. \c, lfi > L0 
cells t and fabricating the detection electronics using hybrid circuit construction 
technology. All pf these improvements should be possible without any major ad- 
vances over the Current prototypes. 
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A vbual observation of a smooth sheet of red metal, a smooth sheet of red wood, 
and a smooth sheet of red plastic ivould not uncover any major differences between 
them. After touching them, however, it becomes clear that they are not the sarne- 
The materials will feel different e\ier if their surface textureB are identical. It is the 
difference in their thermal properties that allows us to tell them apart. 

The human finger's sensing abilities include more than just tactile reception. 
Clearly h metal feels cooler than wood acid plastic. This sensation has nothing to 
do with the absolute temperatures of the materials; if they are in the same room 
they are indeed likely to be at the same temperature. The sensation is in response 
to the heat conduction properties of metal compared with wood and piastk. The 
finger is warm; a constant supply of blood acte as a heating source. When contact 
is made with a good thermal conductor such as a metal , heat quickly flows out of 
the finger. This reduces the temperature of the finger, and hence the metal feels 

This phenomenon is explained by the second law of thermodynamics. When 
two materials are placed in contact with each other heat will flow from the warmer 
one to the cooler one until their temperatures equalize. This heat flow tin occur 

G3 
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by three unique forms of physical heat transfer. Heat flow through connected parts 
of a body is called conduction^ heat flow through unconnected parts of bodies is 
called radiation^, and heat transferred by the relative motion of bodies is called 
cenvttlion, 

The flow of heat in a thermal system is analogous to the flow of current in. 
an electrical system, where a voltage difference induces a current flow. Voltage 
continues to (low between two points until the potential difference is eliminator!, 

The robotic thermal Sensor is patterned after a h\]man fl~^rr K s capabilities. The 
device should be able to distinguish materials by tlicir thermal conduction prop- 
erties alone, by measuring the rate at which a material can absorb heat from the 
sensor. Ey equipping a robot with an artificial thermal sensor., material classifi- 
cation that visual and tactile tensing cannot accomplish, will be possible, In the 
next section potential robotic uses for this device are discussed in more detail. 

S,l Robotics Applications for Thermal Sensing 

An intelligent robotic system can exploit thermal sensing capabilities in a number 

of ways. For example! the material in contact with the sensor can be identified 
by measuring its thermal conductivity properties. If the material type is already 
known t the sensor output could indicate the roughness of the material's surface 
texture; a smooth surface would form better contact with the sensor 1 s surface, 
giving better heat conduction between them, 

A thermal sensor can also be used for extracting tactile like force response. To 
some extent, as the contact force between a material and the sensor Increases, the 
rate of thermal conduction between them will also increasCr The actual materials 
used in the sensor's construction affect the magnitude of this response. If the sen- 
sor is ultimately planned for material identification, this pressure response should 
actually be minimized. These issues will be covered in more detail En the following 
section. 

A two dimensional planar array of thermal sensing elements will give heat con- 
duction images of contact regions. With this, the point of contact between a 
materia] and the sensor can be determined. In addition, objects composed of more 
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than one type of material can he more readily recogn 17^(1 The orientations of a 
writing implement composed of more than one material could be determined fay 
probing at several different locations and recording the types of materials found at 
each point, 

Crimson and Lozauo-Fcrez J19S5| have shown that very few sensor data points 
from an object in three apace are required for ite unique identification. Their work 
f.on ce.ntra.tes on the constraints that tactile data, provide. However, it would be easy 
to extend the methodology to include other tvpe.s of sunsor information, including 
those obtained from thermal sensors. For example, if an object is grasped by a 
robotic hand equipped with tactile sensors, additional thermal sensors can further 
reduce the possible object orientations that are consistent with the overall sensor 
data. 

Equipping a robot with both tactile and thermal capabilities will allow a more 
detailed study of human contact sensing abilities. The interaction between tactile 
and thermal transduction in our Bkin IS not very well understood, and it is likely 
that a complex interaction between the two j^vea rise to out perception of surface 
textures, To better understand how humans perceive F.r.d use contact sensing infor- 
mation,, possible theories that attempt to mimic some of the biological operations 
that the human system performs can be developed and tested on robotic devices. 

When this project was first undertaken + a literature search revealed only one 
reference to a thermal sensor [Darta et al. 1964|, D arm's sen For is based on the 
pyroelectric properties of polyvlnylidenc fluridc. Though his device is interesting, 
it is designed primarily for use as a tactile sensor. At the completion of this work a 
concurrent project conducted by Russell ,1985] was also reported in the- literature. 
It seems that our independent efforts confirm the same result, that thermal sensors 
can provide Useful feedback information. 

3-2 Design of the Thermal Sensor 

To measure heat conduction^ the thermal sensor combines an active heat source 
with an array of temperature sensors. The temperature transducers are mounted 
at ihe surface of the sensor, and record the temperature a,t the junction between the 
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Tablo 3.1: Thzrmal properties */ wiateridA*. 
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sensor and the material being sensed. If contact with a good thermal conductor 
is made, heat Will rapidly flow from the sensor into the material, reducing the 
temperature at the sensor^ surface. The rate of reduction in sensed temperature, 
and the steady state temperature that the sensor assumes, is related to the thermal 
conduction properties oF that ex'erna^ nbjfich. 

The following sections explore this bask transduction principle in more detail. 
First, a theoretical examination of the sensors performance abilities Is presented, 
^ext, a discission of the design and construction principles employed follows. Fi- 
nally, an experimental performance analysis is conducted, with the results con- 
trasted against the theoretical model of the sensor, 

.?. £.i Thwretical Analysis of Sensor Performance 



To better understand the performance of the thermal sensor, a theoretical analysis 
of its behavior is presented, A simplified model of the sensor and the material being 
Eensed that captures the essential pararrif ters that affect the system's response Is 
used. As we Will later see, the acLual output of the Eensor closely corresponds, to 
the results obtained in this, section. 
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To formally classify a material's thermal properties, the parameters of con- 
ductance and. dlffueivity are defined. The coefficient of conductance, K, relates a 
temperature differential to a heat flow, according lo 

- K^> EM) 

where v is the temperature and z is the position along the material's ajxis. This 
quantity captures the intuitive notion that some material & conduct heal better than 
others; the higher their conductance, the lower the temperature difference required 
tor a parti cular heat flow. 

A material's diffuslvity is defined to he 

a = -, (3-2) 

pc 

where K is its conductance, p «e its density, and e is its specific heat. This parameter 

is related to the change in temperature of a unit volume as a unit temperature 

difference allows heat to flow Into the object over a unit time interval. The units 

of a, square feet per hour, confirm this. Table 3,1 lists the thermal characteristics 

or ii number of common material. Tin' wide varictj ..:■'. values of conductivity 

and diffueivity for common substances should ensure different sensor responses for 

different materials, and hence allow/ unique identification. 

The thermal sensor is modeled as a block, and the material being sensed as an 
infinite rod, as shown in Figure 3,1. We are interested in finding the temperature 
at the boundary between the sensor and the material being sensed, This will model 
the experimental response of the thermistors in the actual sensor. The material in 
this section is developed from the excellent discussion of heat conduction problems 
in Cars! aw [IMS]. 

The temperature, v„ of a block ot materia! in one dimension, is given by the 

diffusion equation 

^L-l^L^O (3.3} 

where a is the thermal diffusivity of the material. To reduce equation 3.3 from a 

partial differential equation to an ordinary differential equation, we take its Laplaee 

transform 

f, -«f£«_ I /-,-«»> = , (3.4) 
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X Direction 



u(t)=v(0,t) 



^Figure 3,1: Thermal aertsar model, The black on the Ufi represent* the seasar. Tht 
iflotk on the right i-fprtacntB the material being #cn*vd. 



which becomes 



fix- a a 



(3.S) 



where Vu is the initial temperature distribution on the bar, which we assume to be 
zero. 

The boundary condition for equation 3.3, which describes the interface between 
the block Find the rod, is given by 






:»■•) 



where u{t) is the temperature of the sensor block, M la the mass oF the sensor, c 
is the specific heat of the sensor h jff is the thermal conductivity of the material the 
sensor is in contact with, and Q is the heat the sensor is producing. Intuttivdy, 
this equation indicates that some of the heat produced by the sensor is absorbed 
by the sensor itself, and the rest flows into the materia] being sensed. Sine* the 
rod is assumed to be infinite in length, no boundary condition for the other end is 
needed , We can assume that at time t > 0, since the sensor makes good contact 
with the material, 

u(t) = «fA*), (3,?) 

which allows us to obtain the Laplace transform of the boundary condition in terms 
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of v; 

dv Q 
Mcsv[&) -K—=-~ McV , at x = 0. (3.8) 

We now must find a solution for v(a) which satisfies boundary condition 3.S 
and the governing equation 3 A. A solution that works is 



™ — " 



V(5J Mc. a ar(r + A) + ftr{i> 4- k) * {m 



where 



Jl/cot 1 
» - .-I 



ft 



Taking the inverse Lapliv.e transform of equation 3.9, we can. obtain v{x s t\l 

(3.10) 
where er/e is the Gaussian error function, which is defined by 

«fe(*) = 1 - *j%-*ty. [3.n) 

At the point s = 0„ the above equation represents the temperature variation of 
the thermal sensor itself, 

U(t) = ^V? " Kh + j^"'^^) + V^e&lkV^) . (3.12) 

t'm:r> equation 3.12 we csn o!^- :. i i the g im. behavior ul' '.he thermal senst>; wrien 

It is- placed in contact with a material. Since the trft function approaches zero 
rapid Ey> the initial value of the sensor when placed in contact with an object will 
fall from V$ to 

K \ <s Eh l J 

Figure 3.2 shows the hehavjor of equation 3.12 u <x and Af are varied. 
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3.S&.S Performance- Issues 

'[■,<: r. !■■-.! jiii o: li t::vr:ii: , .l ■■ i-n =■■ r h v\v: r-\ 1.0 Li:c . ;:-:ii:\-:i. :T-:-=f>< n :c -, ..-= i : >: i^ moFl 
interested in sensing, This chapter wi!l cover sensors that use heat conduction 
:-iiTi:-:i\ri ; —.l:- for po:-!lmn !n,:;.lv:: ',.:;• . j.nr] n;-.- : i.J ":b i lifi: .M i. -h. 

Several factors affect the sensors accuracy when used for material identification. 
Ideally^ the sensed object should be in firm contact with the sensor. The heat flow 
from the sensor to the sensed object should be entirely unimpeded. This means that 
increased pressure of the sensed object to the sensor should have a negligible effect 
on the rate of heat conduction between them. Tn essence, the thermal resistance of 
the gap between the sensor and the sensed object should be minimal. 

Selection of an appropriate covering material for the sensor can taaist in achiev- 
ing good thermal contact between the sensor and an external object. A slightly 
compressible material that conforms to the surface of an object seems ideal. If the 
material defects substantially with pressure, however, the thermal sensor will have 
a significant pressure response. While this would be undesirable for material iden- 
tification,, it does allows construction of a sensor with tactile response. The more 
compressed the sensor covering become^ the better the thermal contact between 
the external object and the sensor's transducers. Hence, the sensor gives a tactile 
pressure response. 

The covering material must also provide protection for the sensor's transducera. 
The electronic components tbaL measure the temperature at the surface of the 
sensor should be shielded from the damage that pressing the sensor against objects 
could cause. In addition, the covering must provide a surface that is adequate for 
the overall functions of the end-effector that it is mounted on; while the sensor- 
might be a device just used to gather exploratory information s it is more likely to 
be a part of an overall robotics system, and incorporated into existing end-eJTector 
designs. It will need to function not only as a sensor,, hut as the gripping surface 
for the robotic device. 

When selecting the covering material for a multipoint array sensor other issues 
mu at hfi considered., A material with high thermal conductivity will have the 
desirable property of conducting heat in an unimpeded fashion from the sensor 
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to the external object, However, it may also be a good heat conductor between 
adjacent sensor pixels. This will, in erTect, blur the readings of nearby points, and 
reduce- Lhe overall spatial sensitivity of the seneor r 

To overcome this blurring effect, it is desirable to select covering materials that 
conduct heat best in the vertical direction. Certain materials that we are looking at 
have properties that meet this requirement, including a silicon elastomer embedded 
with lateral conductive strips [Chomerks(. Selecting very thin materials Eh at are 
relatively poor thermal conductors may also help. While these material reduce the 
Tate oF heat How between the sensor and the sensed object, and hence reduce the 
overall! sensitivity of the sensor ,, they minimize blurring.. A very thin material's 
lateral insulation effect would be minimal. 

The actual medium that the sensor's temperature transducers are mounted on t 
and the location of the active heat source, are two additional important design 
factors. The sensor transducers are mounted on some material which, of course, 
conducts heat between adjacent pixels. In addition, the mounting material will act 
as a thermal reservoir, reducing the overall response speed of the sensor. 

When an object comes in contact with the sensor, heat ie conducted off both 
tbe temperature transducers and the sensor's overall packaging. The more heat 
the entire sensor stores^ tbe slower its response rate, Ideally, if the transducers 
were entirely isolated, and they supplied their own source of heat, contact with an 
object would draw heat directly from them, and would be immediately measured, 

This section has provided information useful For constructing a "lherrn.il sensor, 
The Following sections discuss the scanning electronics and the fabrication process 
employed for the prototype device. 

$,2.8 Fabrication Details 

The thermal sensor uses thermistors for its temperature measurement transducer. 
Thermistors are semiconductor devices whose resistance changes with temperature 
according to the equation 
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wbm J? t is the resistance at temperature t t R& \$ the thermistors nominal re- 
sistance, and K ttuim is the coefficient of resistance with temperature, Typically, 
■ffjjiepift >s approximately -0.04/C\ giving ft reasonable variation in resistance for 
small temperature changes [Horowitz ]9Kt)|. 

Thermistors are appropriate for several reasons. Moat important [y t they are 
available in small surface mount packages , allowing placement at close intervals. 
In addition, thermistors have a relatively large variation of resistance with temper- 
ature, greatly reducing the complexity oF the detection electronic, and. reducing Lhe 
device's overall aise, Finally, their linear response curve simplifies the calibration 
procedures required. 

A 4 x 4 array of thermistors, providing 16 temperature sensing elements, is 
attached to a flexible printed circuit board. The thermistors are placed 3,5 mm 
a pari, giving the sensor a 10.S square mm area. Use of a flexible printed circuit 
board allows the sensor to he mounted on curved surfaces such as the fingers of 
the Utah-MIT hand. Each thermistor must be connected to a row conductor and a 
column conductor to allow the cell to be scanned by the detection electronics. The 
top surface of the circuit board provides the upper f.onductors. while the bott 



om 



74 



Chapter S Thermal Sensing 





Figure 3.4: Photographs of the thermal senior. Lt-fti ezpoita" vitw of the thermMtts 
aii.adie.rf En (At flexible printed drcv.it board. Right: incur after thtrmatiy conductive covering 
has if-ccn applied. 



surface provides the perpendicular lower traces (see Figure 3.3). The thermistors 
are" attached to the circuit board using cither Solder Of a conductive glue. The glue 
h somewhat easier to apply to the small devices, and provides an adequate bond. 

A photograph of the exposed thermistors attached to the flexible printed circuit 
board is shown in Figure 3.4. To smooth the surface of Lhc device and fill the gaps 
between the discrete thermistors, a layer of thermally conductive .silicone: rubber is 
formed over the entire surface of the board. This not only protects the thermistors, 
hut it averages out the temperature response between the gaps- present in the 
thermistor array, T'h^ lower photograph in Figure 3.4 shows the sensor after the 
conductive rubber h?j befin applied. The -electronic component seen m the picture 
arc for the detection electronics of the tactile array which is to be mounted, above 
the thermai sensor in the near future. 

The thermal sensor's beat generating source is placed, behind the flexible printed 
circuit board r The heater uses an electrically conductive paint to provide resistive 
heat. Wires are attached to opposite sides of a layer of conductive paint, giving 
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Figure 5- 5; Thermal sens-or cross st-clion. From lap to laHvm; ikr,rmo.Jl'j protective 
covering, therm-islam, flexible prjtslerf circuit board, electrical thieldmg, heating padf. 

a uniform current flow, and hence providing uniform warmth. The heater cannot 
be mounted directly onto the back of the circuit board, since it would short out 
the conductive traces. Instead, a thin layer of electrically insulating but thermally 
conductive jjaint is applied between their two surfaces.. 

To summarize this section, Figure B.-S shows a cross section of the sensor. The 
top layer of thermally conductive rubber form the sensors outer covering. Next 
come the thermistors, attached, to the underlying flexible printed circuit board, 
The back of the board is covered with an electrically Insulating paint. Finally, a 
resistive paint is applied over this covering to provide the beating source. 



S-g.l Detection Electronic* 

To minimize the number of interconnection wins that are needed to drive the 
thermal array, and to detect the resistance of each of the thermistors, a. matrix 



76 



Chapter S Thermal Sensing 



B_H 






Multiplexer = 




Column Row 

Select Select 



—Out 



R sensed 



Un selected _ 
Thermistors 




Vout 



Figure 3.6: Thermal array tcanning clectronies. Top; evcraif echematic ffihe thermitter 
array and the multiplexing and detection electronic*. Bottom: effective schematic when one 
column has ban. eeUitcd. 
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scanning approach is e-rnploycdL Only one wire for each row and each column of 
the sensor is needled r For the 4x4 sensor, this reduces the number of wires required 
from 32 to 8, and is obviously desirable. The overall electrical schematic for a 4 X 4 
array is shown in the upper diagram in Figure 3.6. Kotice that one terminal of each 
thermistor is connected by parallel wires and that the Other terminal is connected 
by a perpendicular set of parallel wires. This interconnect scheme can. easily be 
realized with a two sided circuit board. 

It is possible to isolate the resistance of any of the thermally sensitive resistors 
in the array. To read the value of a particular transducer, the column that it is 
located on la selected with the column select demultiplexer. This will apply a fixed 
voltage to that column! and tie the other columna to ground. The rows of the sensor 
are connected to amplifiers in an inverting amplification configuration-, Since the 
positive input of each of 'he amplifiers is Lied to ground, the negative input will be, 
in effect, at a virtual ground). This allows the resistance of the selected thermistor 
to be read without ambiguity, 

Figure 3,6 shows the effective schematic when a particular column of the sensor 
is selected. From this we see that only that particular column of thermistors can 
have an appreciable effect on the row amplifier's output. Since the negative input of 
the amplifier is at a virtual ground, each of the unselected thermistors ire effectively 
tied to ground and no appreciable current can flow through them, The resistance 
of the thermistor is obtained from the output of the op amp, and is given by the 
well known equation, 

V^ = -V ia ^- t (3.15) 

where /£ ienjed is the resistance of the selected thermistor, and R^f is the op amp 
feedback resistor, 

In selection of the nominal rcsi^'ance values for the thermistor it is important 
to consider their self heating effects. The thermistor wilt generate a detectable 
amount of heat flow if its nominal resistance is too low, which, can interfere with 
the sensing process. Hence, the nominal resistance of the thermistors should be 
high. For our prototype, 5000 ohms was chosen. 

By self heating the thermistors it is pnsaihle to eliminate the need for a separate 
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heating layer. If the resistance of the thermistors are Low, the current flow through 
them will generate heat. The scanning electronics could be modified to maintain a 
constant voltage across each thermistor by rejjLilatiiig. the current flow. The current 
flow itself would be used to determine the heat conductivity between the sensor and 
the sensed material. Unfortunately, small thermistors with a low enough noimnal 
resistance to generate an apprnpjiai<* lev^l of sf If heating were not availahle. Since 
the performance of the sensor would be severely diminished by; reducing its heat 
output j, a separate heating layer is required. 

3.3 Experimental Result 

To evaluate the performance of the prototype sensor a series of experiments were 
conducted using the previously described 4x4 tbermistor array. The teats inves- 
tigate the fiensor 1 E sensitivity, repeatability, response speed, and spatial accuracy. 
For each af thE experiments,, a graphical representations oF the sensor output plot- 
ted against time is shown. 

S.S.l Material Mcnlificaliun 

One of the primary uses for the thermal sensor is recognition of an unknown mate- 
rial from a library of thermal profiles. From the previous discussion we can expect 
that tl:t temperature at the surface of the sensor will drop at an exponential rate 
when placed in contact with an object. The shape and final value of this curve, 
as we now know, is related to both, the diffusivity and conductivity of the sensed 
object, in addition! to characteristics of the sensor itself. Material recognition can 
be established by matching the sensor's response to a library of response curves, 
where a good match constitutes identification. 

To measure the sensors effectiveness in distinguishing among different objects, 
the following experiment was conducted: a number of objects were placed in con- 
tact with the sensor, and the temperature over time response was recorded, Figure 
3.7 eIiowe plots of the response of one sensor pixel after contact with the materials 
have been made. The sensors temperature response to wood., aluminum, steely and 
brass is shown to differ siunilicimtly enough to distinguish among, them. Though 
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the elapsed time shown on the plot is fairly long, positive recognition can be ac- 
complished more rapidly. The temperature curves separate from each other after 
only a few seconds. 

Figure 3.8 shows the temperature response profile for aluminum over a long 
time period. It takes over 200 seconds for the sensor to reach tts steady state con- 
dition.. Notice that aFter 25(1 seconds, the Sensor's temperature Starts to increase, 
This behavior was predicted in the theoretical model developed previously. It 
should foe positble to obtain an unknown material's thermal parameters by fitting 
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Figi]ro 3-.S: Tker-ntoi vtwdy tl<nlc TCJjwn-s-r curve for aluminum, Over £(?Q seconds qtc 
required for aluminum to rtach lis steady state ttmptraturc. Notice that the senaot'a l&ia.- 
penttvr* eventually Mart* to intrnttt, 

a theoretical response curve to the sensor's output. 

It should be noted that the surface texture of a material being sensed affects 
itE overall thermal profile. This interesting result is caused hy variations in the 
quality of the thermal contact made between the sensor and the sensed object. 
A rough texture has many gaps in its surface. The gaps are filled with air, and 
form a thermal insulation layer between the sensor and the object. Since material 
identification is made by comparing a thermal response curve with a library of such 
curves, this effect should not cause problems- with the sensor's operation. In fact, 
the ahi';ity to distinguish a rough Finish from a smooth. Jhilstt could bn an advantage 
in some situations. 



S.SrS Measurement Rtptntebtiity 

To successfully identify a material against a library of thermal response curves, the 
sensor^ irLGiiUrtiTieiit* should be rcpeatable. To test this, an aluminum block was 
repeatedly placed on the sensor, and the response curves were recorded. Figure 
3.9 shows several of these plots r While some variation in sensor output over time 
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Figure S-9: Tisrmii/ .jefwer repeatability. The curate sfioitf (At sen/tor'tr rttjppn-jfe re 
conlart um th the same black of alumi'iium Jukj'hj J t^'ala. 

lb present, in general,, each of the trials produces similar results. 

It should be noted that the materia] was pitted on ihe sensor in a. somewhat 
haphazard manner. For example, no special setup was used to ensure constant 
pressure from, trial to tri&L This should be similar to the Eensor's actual operation 
conditions. 



S.S.S Venation in Heat Output 

The previous experiments were performed with the senior generating a fixed amount 
of heat. In particular, 0,5 Amps of current were running through the heating 
source, generating D r 3S watts of heat output. To determine the effects, of varying 
heat production the sensor response it three different heat levels was monitored. 
A piece of aluminum was placed in contact- with the sensor generating Cl.DE). Q.3S, 
and 0..&1 watts of heat. From the plots in Figure 3.10 one can see thaL increases 
in heat output give larger variations in the sensor'E thermal response, while the 
general shape of the curves do not change. From this we see that increased heal 
production gives the sensor greater sensitivity. Of course there are limitations on 
the operation temperature of the sensor; tor example, too high a temperature could 
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damage the sensor or the object being sensed, 



S.S.4 Thermal Temperature Recovery 

When a material is removed from the sensor [; .some time is required for the sensor 
to return to its si cadi' state temperature. To determine this recovery time, a block 
of aluminum was placed in contact with the sensor, and then removed. The tem- 
perature profile of the sensor was recorded during this experiment, and is shown 
in Figure 3.11. From this we can sec that !>0 seconds elapsed for a 90 percent tem- 
perature recovery. This Is rather slow. However, it should be possible to reuse the 
sensor before full temper ature recovery, Tn Figure 3.10 t hernia] profiles are shown 
For the same material with the sensor operating at different initial temperatures. 
The general shape of each of the curves is the same; the variation that occurs is 
just in the sensor's initial and final value. From tills, we can conclude that it ie not 
important for the sensor to operate at a constant temperature. 

If Faster temperature recovery was felt to ha important, the heat output could 
he varied. By increasine; Lhc current flow through the heating layer, additional 
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Figure 3.11: Thermal temperature :>.:-.-i i r^ .-l/l-.r i^l i- ij- .-.-." it- '• '•. -v-^/r-.v! c. ■. ?i .',■.■■■ ' -■- ■".■ >■ 
i&e fenffoi- 4 .fate Jtn»e is r^ W i>«rf for the pad's temperatxre tv rclum- to its steady state 
valve In the first phase af the graph, a material is in contact with the sensor. When the 
temperature rerteAuj t'($ hweet ppint, the object has been removed, and temperature reccivery 
begins. 

heat could be generated on demand- In addition, the sensing Scheme utilizing 
self heating of the thermistors would speed the recovery pTQcess, Here, the sensor 
attempts to maintain a constant temperature at the thermistor sites as part of the 
measurement process. 



S.S.S Pressure E$e.£ts 

As pressure between the sensor and the sensed object is Increased, the thermal 
contact between, them also improves. This effect allows, the thermat sensor to he 
used for tactile perception. As pressure is increased, the rate of heat flow from the 
sensor to the sensed object increases, Of course, this effect makes it harder to do 
absolute material type identification. If the contact force is unknown, Or the Force 
je changing over time,, the effects due to material type will need to he isolated from 
the effects due to the contact pressure. This could be ascertained by giving the 
robot both thermal and tactile sensors. 

Figure 3,12 show the sensor output for aluminum pressod into the sensor with 
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Figure 3,12: Thermal pressure response -uan'oiion. Tie upper $ curves show the response 
for a font a' num. as it is pressed into the sensor at di^ertnt fatten. For re/ere»ft f {&? ta&tr 
curve fl&CUVS the rciporisc fay ^TftfS, 



3 deferent fortes, Tlie applied forces range from 1 to 2 pounds. For referents, the 
lower curve shows the response for brass. Notice that there is a, significant difference 
between a.11 the aJuminum responses and the brass response. This ifidi^teaj that 
even if the applied pressure is unknown, an adequate difference in sensor output 
exists, to distinguish, between those two materials, 

This version of the sensor uses a covering material that attempts to minimise 
the effects of pressure on therms! response. The response variations, detected here 
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are considered undesirably since we designed the sensor for material identification. 
For tactile applications, a more compressible surface covering could greatly increase 
Its pressure sensitivity. 

$.$.6 Spatial Selectivity 

The pixel grid of the 4x4 version of the sensor gives thermal conduction images* of 
an object, This information can be used to determine a materials spatial position, 
as well as its heal conduction properties. To visualize the data gathered by the 
array, three dimensional plots of its output are shown. The better the thermal 
conduction of a point, the larger its rvalue on the plot. In Figure 3. 13 the response 
of the entire sensor pad as it is probed wi:h an aluminum and wooden rod is shown, 

S.tf Combining the Tactile Sensctr and the Thermal Scm^nr 

The tactile and thermal sensors previously discussed provide useful contact sensory 
feedback information. Ideally, a sensor could be designed that incorporates both 
these modalities Into one device. This section briefly discusses the modifications to 
the tactile sensor and the thermal sensor that would be necessary to achieve this, 

3.4*1 P er for matte, c /ssnes 

Merging together the capacitive based tactile sensor and the thermistor based ther- 
mal sensor is relatively straightforward. Since the tactile sensor requires mechanical 
contact with the material being sensed,, it should form the outer surface of the dua! 
modality device. The thermal sensor relies upon the conductive transfer of heat, 
and will work when placed below the tactile device. 

Stacking the tactile sensor above the thermal sensor has the undesirable effect 
of increasing the thermal mass of the overall device- The analysis of the thermal 
sensor's performance indicates that the mass of she sensor plays a significant role in 
the performance and sensitivity that can be obtained, bower sensor mass increases 
the rate of temperature roltoFf and hence decreases the response time required for 
characterizing the sensed material. 
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The real problem with increasing the sensor's mass Is that its heat capadty 
also increases, To improve the performance of the tactile-thermal device, materials 
that minimize the overall heat capacity should be selected. To da this h the capaci- 
rive aencor Ebould he constructed with. thermally conductive components whenever 
possible. 

$.4,? Potential Sensor Construction 

The tactile-thermal device is constructed by overlaying the thermistor based ther- 
mal sensor above the capacitive based tactile sensor, Figure 3.1 4 shows a cross 
section of the the entire device, and indicates the functionality of each surface. 
The lowest layer is a protective backing and mounting surface. The thermal sen- 
sors heating supply is placed between that layer and the backing of the thermal 
sensor's printed circuit board. Next, the thermistors are mounted onto the top of 
the circuit boards, and a layer of thermally conductive silicone rubber is. molded be- 
tween them. The tactile rhtisw is- mounted onto this surface. The lower conductive 
strips that form the force sensing capacitor? are applied to this surface, Electrically 
conductive! silicone rubber is used for the plates, and is deposited directly onto the 
upper surface of the thermal array. Next, the elastic-dielectric sheet is bonded onto 
the surface with the upper conductive traces applied to its surface. Finally, a layer 
of electrically insulating and then electrically conducting silicon rubber encases the 
sensor. 

The materials used in the combined sensor should be selected according to the 
previous sections discussion. The elastic-dielectric materia], for example, shou'd be 
made of a thermally conductive material. Since this layer is rather thick compared 
with the rest of the device, it could form a thermal barrier, reducing the thermal 
sensitivity. 

Since the materials to be used within this device is similar to those required for 
the individual tactiSe and thermal sensors, one would expect that its performance 
and ease of fabrication would also be similar, In addition, it is not much larger than 
either of the previous sensors, making it suitable far mounting on the Utah -MIT 
hand . 
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The preceding chapters of this report, have described two contact sensors suitable 
for use with the Utah-MIT Four-fingered dexterous hand- In the near future they 
will b€ mounted onto 65 many as twelve surfaces oF the hand's fingers, pernn". ting 
detailed investigation of sensor driven control strategies, Imagine the wealth, of 
data that will be available from these devices; clearly ample computer power to 
proems the sensor information in real-LiTne must be made available to fully reap 
the benefits that they will bring. 

This chapter describes the pr ; rwy <;r>rnponej-.t.5 of a computational architecture 
with performance capabilities that meet our sensor based control requirements. 
Most importantly, tfie system provides adequate processing power, flexible soft- 
ware development tools, and operating system primitives appropriate For control 
progT?.mmlnR. 

Conventional hardware and software configurations- will not be adequate for 
the computer requirements oF the hand. Controlling a dexterous robot is a highly 
complex computational task in itself. The Utah-MTT hand's 16 degrees oF free- 
dom and iV& 32 electropneumatic actuators pose an even greater challenge; the 
high speed of the specially designed actuation system requires servo loop rates in 

m 
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excess of £00 cycles per second. The additional compulations that sensor driven 
control strategies will add complicates matters, and further increases the computer 
requirements of the overall system. 

The flavor of this chapter is practical in nature; the work was initially motivated 
by the impending completion of tlie Utah-MIT hand, and the Lack of a computer 
system powerful enough to Support its control. This chapter's title, however, may 
be somewhat misleading in that the information is noL specific to the control of the 
sensor equipped hand. In fact> most robotic controllers would benefit from design 
strategies similar to the ones described here. 

The work described in this chapter is part of an ongoing development effort 
to provide computer hardware and software suitable for robotics real time control 
applications. Sundar Narasimhan has played a key role in this effort and a Forth- 
coming joint publication will Fully describe the details of the system. This chapter 
just presents an overview of the system's key concepts. 

In the next sections, general design principles, and specific hardware and soft- 
ware implementation details are covered. The chapter concludes with some pre- 
liminary performance and timing results. 

4.1 Design Methodology 

Time was perhaps the most important constraint on the potential system's de- 
sign. The intent of the project was to control a sensor equipped hand, and not to 
design, the ultimate in computational arc bit<w.ti ires. Second to this, flexibility to 
accommodate various software strategies and future hardware enhancements were 
considered important. These two principles helped US realize a powerful system 
suitable Fcir controlling the hand in a [nodes; t time period. 

An early decision was made to use off-the-shelf hardware whenever possible. 
Custom computer hardware is usually not cost effective when only a few systems 
are to be built and when the computational requirements are suitable For general 
purpose computer architectures. In addition, keeping a custom built system at the 
state of the art requires constant improvements in the hardware, a never ending 
proposition. Since commercial companies specialize at this, it i* silly for a research 
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group to compete wiLh them. 

An initial examination of the types of computations that are to be performed 
indicated that multiprocessor based hardware woLeld work well. The computations 
could be partitioned onto several processors in a Straight forward fashion that would 
not require excessive interprocessor communication. 

Using multiple processors is advantageous for several reasons, Most impor- 
tantly, additional computer power can he obtained incrementally by Adding pro- 
cessors to the system. In addition, the control program structure is simplified by 
partitioning separate operations onto their own processor. A uniprocessor would 
require a more complex scheduler, since many time critical events would need to 
be serviced in a complex fashion. Using multiprocessors alleviates this need. 

Since this system is used primarily as a research tool, it is important for the 
software development environment to be reasonably flexible, yet at the same time 
programs must run efficiently. These two goals are often conflicting, and a compro- 
mise between them must be made. An examination of two extremes In development 
approaches illustrates this point. The Lisp Machine provides an elegant and pow- 
erful programming environment. However its flexibility makes it unsuitable for 
real time performance; a program is so far removed from the machine's underlying 
hardware that eJTiciency is hard to achieve, Dedicated low performance microcom- 
puter s a such as those used in the Unlmation Puma controller, are at the other end 
of the computational spectrum. While they are suitable for handling real time 
events, they must be painfully programmed in assembly language, and lack the 
capabilities to support any kind of reasonable development environment. 

Another important question concerns the appropriateness of a computational 
hierarchy. In some robotics controllers, such as the MIT Puina system, only '.he 
lowest level control functions are relegated to the microprocessor front end, For 
many control tasks this necessitates relatively high bandwidth and low latency 
communications between the high level computer ami '.he controller microproces- 
sor!:-. The necessary rates are often hard to achieve using conventional hardware, 
such as an Ethernet connection. To avoid this problem altogether, our system de- 
sign assumes that almost all time critical processing, including high level functions, 
should be hmidlod on the microprocessor controllers, 
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Tflhlfi -i.l: Comp-utalional Component of Hi" Hand Controller 



Processor type: 




Motorola 68000 


Clock rat*: 




12 megahertz 


Instruction rate: 




*1MIP 


Processor on board 


memory: 


512 kilobytes 


Total processors: 




H 


Total memory: 




i megabytes 


Bus Architecture" 




Intel Multibus 


Analog to digital converters: 


,120 


Digital to analog converters: 


40 


Host computer: 




Yax via DMA Link 



Finally, a key consideration in the design process was to ensure an easy path 
to future bardivare and Aoftware upgrades. This requires, all software to have a 
device independent structure. In fact, we are already in the process of our first 
system upgrade^ the current Motorola 66000 processors are being, converted to 
higher performance Motorola &S02Q ; s, So far the system port has gone smoothly, 
indicating that this requirement has been met. 

4.2 Coat roller Architecture 



Since almost all computer software and hardware projects seem Lo be Riven a name 
these days, we were forced to do SO ourselves. The acronym decided upon was 
U MUSE"', It stands for various things, as do all computer science acronyms, in- 
cluding the "MIT-Utah Servo loop- Executor". This tec lion describes the hardware 
components that the MUSE is based upon. 

The processing engines used are based on a 12 megahertz Motorola 68000 single 
board computer. They each are equipped with £12 kilobytes of storage, a prioritize 
interrupt controller, three event timers, and two aerial porU. Tkcse features prove 
useful in various software components of the controller system. Por comparison 
purposes, Lhcy perform integer arithmetic at approximately the rale of Digital 
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Flgure4.lt Microprocessor eonlroUcr btoek diagram- A Multibus mterconntett S SBQGQ 
Ittnl aitiftt iaanf computer* and numerous data- acquisition d&victt. A pair of PMA WB- 
troltcrs link a VAX host com jjuirr to the system. 



Equipment** VAX 11/750, Table 4,1 lists the system's components. 

The eight processors and the peripheral equipment are interconnected with an 
Intel Multibus. Each processor can become ft bus mQ$Ur> allowing It to take control 
of the bus and acccas the shared peripherals. A parallel oriented priority resolu- 
tion controller arbitrates the processor bus requests, and grants bus control to one 
processor at a time in a fair fashion. In addition^ each processor's memory is duai 
ported; it can be; accessed locally by the processor itaelf, or it can be accessed Rloh- 
ftlly by any other bus master. The hardware utilized provides maximum flexibility 
Tot system reconfiguration since all processors can freely access all resources on the 
bus. A. block diagram of the system is shown in Figure 4.1. 

To Faciei laic i n tcrprocessDr commurLication, some additional hardware support 
is helpfuh Since each processor's memory is dual ported communication utilizes 
shared memory exchanges. To Insure orderly access to common state information> 
a test and set instruction allows semaphores to be gracefully implemented. Tbis 
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instruction sete an internal processor flag and sets a bit in a specified memory 
location,, only if the location was initially dear. The key point here is that the 
'^testing" and "setting* occur in the same memory cycle, Without this hardware 
feature two processors could set a global flag at the same time, giving both of them 
access to the common information. The first processor could test the flag, and find 
it free. The other processor could, obtain use of the bus. on the next cycle, and also 
Sncl the flag clear. The first processor would then gain control of the bus, and set 
the flag. The second processor would then do the same, setting the flag for the 
second time. Both processors would think they were the only processor with access 
to thf* shared resourced 

Another feature used for interproceasor communication is a mailbox interrupt. 
This allows a processor to generate an interrupt on another processor by writing 
to a particular location in that processor's memory. The interrupted processor can 
then use the contents of that memory Location as a flag indicating an action to take 
in response to the signal. 

The microprocessors are connected to a VAX 11/750 host computer with a high 
speed dirtd memory access (DMA) link. This connection allows the VAX to write 
data directly into the contents oF a microprocessor's memory, During a transfer the 
DMA controller on the Multibus becomes a master and writes directly to a micro- 
processor's memory through its dual port, DMA transfers from a microprocessor 
to the VAX are also possihle. However, limitations in the structure of Multibus 
global interrupts make it convenient for only one microprocessor, hence referred! to 
as the master, to initiate tra^fcrs in this direction. 

The DMA connection between the microprocessors and the VAX allow data. 
to he cKC hanged at a peiak rate in excess of 20O kilobytes per second. The actual 
transfer rate obtained in most situations is lower and depends on such factons as the 
transfer size and the load on the VAX, However the hand width is higher than what 
could be achieved with either serial porta,, parallel ports, or ethernet connections, 
•i : n onr.es i Ins ( : .v.'.n in-.:: -la is initiated no processor iiLtervuiiii-ni i- necessary. 
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4.S Software Com pen elite 

Software is developed on a VAX computer running Berkeley UNIX. Code is pri- 
marily written in C s with only a few of the lowest level routines coded in assembler 
language^ By utilizing a high level language,, both the operating system prim)' 
tives and the control code itself maintain a high, level of hardware independence. 
Since the system Is intended to be continuously upgraded with more advanced and 
powerful microprocessing hardware,, software device independence is extremely im- 
portant. 

In a. typical development scenario, programs are written on the- VAX host in C, 
cross-compiled for the microprocessors^ downloaded using the DMA link, and then 
executed. The compile and download cycle Is rather fast due to the DMA link's 
speed: a download takes approximately one second. A primitive debugger that 
tan be loaded with a program permits setting breakpoints and examining memory 
locations. At times the more capable debugging tools available on the VAX can 
also be used. Since the VAX and microprocessor have compatible C compilers, 
routines will often run on both systems with little modification. 

A software library of useful primitive procedures allow convenient use of the 
hardware* and forms a key component of this system. Functions to handle inter- 
task communication, servo loop execution scheduling, file serving, and terminal 
interaction are included. 

The message passing based interprocessor communication system allows the 
microprocessors and the host computer to exchange information. This communi- 
cation scheme is device independent in the sense that the processors sending and 
receiving a message need not know how the information exchange actually takes 
place. This system Is critical for building device independent application software. 

The servo loop execution system provides a primitive operating system sched- 
uler. Using the servo loop scheduler, a number of different speed servo loops can 
be executed on a processor at the same time. When all the servo loops are idle a 
background task is activated. Since servo loops are mo at extremely high iales h the 
scheduler's efficiency is of prime concern. This component illustrates the tradeoff 
between efficiency and flexibility quite well. A general purpose operating system 
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permits maximum scheduling flexibility, at the expense of efficiency. Simple timer 
driven interrupt loops require little execution overhead, but they are Inflexible-. The 
servo loop scheduler is a corn promise between these two conflicting requirements. 

The file server allows the microprocessors to access files on the host computer. 
Standard Unix-Like system calls are used. The file serving operations, use the DMA 
link for high performance transfers,. A process on the VAX receives file request* 
from the microprocessors and generates the Unix system calls to handle them. 
Terminal interaction among the microprocessors and the host computer utilize 
lower level file server capabilities. Microprocessor input and output occur over 
streams that are mapped to terminal input and ouLput queues on the host. 

The aervo loop scheduler and the message phasing system provide the basis for 
most of the functionality in the computational architecture support library-. To- 
gether these subsystems provide the minimal level of flexibility needed for a control 
programming environment p and provide the control software with, the necessary ab- 
stractions for device independence. The next sections discuss these systems in m™ 
detail. 

J.S.l Servo Loop Scheduling 

The servo loop scheduling system (SLS) allows a processor to run various control 
loops at different rates in a highly efficient manner, Since a typical hand control 
program will have several servo loops running at rates in excess of SCO herta, it 
is important for each scheduler invocation to be fast. To achieve this h scheduling 
flexibility has- heart limited tD minimiEe the execution overhead that it requires. 
In Fact, iL is a gross overstatement to call this an operating system. It is, in fact, 
just an eflkient utility for programming a system timer and for starting procedures 
based on precomputed rate information. 

The program listed in Figure 4.2 uses- the £LS to schedule loops running at 
£00 hertz and 1000 hertz. The al3-.se hftdula routine is called for each task; a 
symbolic name for the procedure, the C procedure name itself f and its rate in 
hertz, are passed as arguments^ The call returns a pointer to the servo loops 
scheduling parameters.. The a la -s tart initiates execution of the loops. The code 
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malnO 
( 

int force, position : 

/* initialize the system «/ 

fores = sis -schedule ("force control loop 11 , servelOi 1000); 

position = e Is -schedule ("petition control loop", servo20. 5CO) ; 

/* start in position control mods */ 
sis-pause (force) ; 
sls-atartQ ; 

/* the following, code runs as the "background* 1 Job */ 

als-pause (position) ; /* now switch to.,, 

els "re suae (force) ; /+ ... force control mode =*/ 

sis-pause (force) ; /* new iwitch to... */ 
sIbt-qsucq ^position) ; /* ... position control mode */ 
} 

aarvolO 

/» code for ths force control loop */ 
f ore * .control ^update ; 
> 

servo? 
{ 

/* cods for the position control loop */ 
position_controL_ update (} ; 
> 



Figure 4.2: Sample use cflhe &tvv& li>i>p scheduler. In Ihif tza.mple, s program schedules 
twt strvo hops. In the backsmund job tait, fare* control and position eontroi are selected 
using tke slB-pauee a n d si & - re t; ume cam.jn.ii.Tulx 
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following the ala-start command la referred to as the background j'ofe, and runs 
when the servo loops are idle. 

Two additional commands, al a -pause ami ale -re sum*, allow specified servo 
loops to be suspended and restarted. These commands can be used by a servo loop 
or the background job. As shown in the example, a system that has a position 
control mode and a forte control mode might schedule two loops; one for position 
control, and the other for force control. The sis-pause command could be used 
to disable the position control loop when the system is running in force control 
mode. To switch to position control, the force control loop would be paused, and 
the position control loop resumed. 

A benefit of the SLE is that it simplifies the structure of control programs; 
1 Ik 1 i-li-l =i : l-= 'J :\u- i: it' 11 pi a: .1 1ir>-i h?.rdwaTf ar<- nn: mixed in with the control 
program code. This increases the overall portability of the system, 

To minimise execution overhead, iLe SLS is table driven. An. event table is 
automatically generated by the system, when the sis- start command is issued, 
This table lists the elapsed time between invocations of the scheduled servo loops. 
For example, the event table for two servo loops, one running every ten seconds and 
the other running every Five seconds lias two entries, The first entry indicates that 
both loops are to start r and live seconds elapse until the next event, The second 
entry indicates that the five second loop should start, and another five seconds are 
to elapse before the next event, After this, the cycle repeats, and the first entry of 
the event table is reused. 

With the system outlined so far, it is possible fur more than one loop to be 
rnnnable at the same time, The system must have an orderly method For selecting 
the actual loop that will be run from the set of runnable loops. A process tabl*. is 
maintained for ■'.'■• :i 1 1 ' ji os* 1 , A I' Mr; V:-.>k? in the syslciTr:. urr ;i: railed, in urdur o: 
decreasing servo rate v in this table. When the event table indicates a loop is ready 
to run, it is marked runnable in the process table. The system then searches down 
the process table, and starts the fastest rate loop that is marked runnable. 

The time to the next event stored in the event table is loaded into a timer on 
the processor. When the time has elapsed, Lhc running task is interrupted t and 
th* scheduler is reinvoked. The next tasks in the event table that are scheduled to 
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start are marked runnable in the process table. If a loop with a speed slower than 
the interrupted loop Is made runnable, the Interrupted Loop will be resumed. If a 
high fir speed servo loop is made runnable the slower loop thai was interrupted will 
be temporarily suspended, until higher speed Loops that are runnahlc complete. 

An implication of assigning a priority to a process, based on its rate is that a 
Loop can only be interrupted by a higher speed Loop, and hence, no coprocessing 
can take place. This is not considered to be a problem. The rate specified for a 
servo loop is a request that the Loop be run that number of times a second. The 
exact time that a loop is invoked is not important, as Long as it is runs within its 
f nor. i fifirl linn? •\'-'i-, \n '.I-,!: -.v-rd-. a loop schedule: - :■. 11 ■? v i,t >. ;'.■: on ■■.[ i^ onlv 
a guarantee that the loop will run sometime within a second. A finer precision in 
selecting the time at which a procedure will run is not needed within our control 
programming scenario. 

Coprocessing is not supported in the SLS's restricted scheduling environment. 
Eliminating coprocessing results in a convenient simplification to the system; only 
one stack need be maintained for all the eervo processes running on a processor. 
Stack pointers are not changed when a new process is invoked, or a suspended 
process is resumed. 

When a Loop terminates, the scheduler is also invoked. The terminating Loop 
is marked idle in, the process table, and a new bop is selected to run. If no servo 
loops in the process table are runnable, the backgrotJ rid job is activated - 

To help clarify the above discussion, Figure 4.3 diagrams the reLationstdp be- 
tween the different components of the SLS. In thk example, two Loops are scheduled. 
Loop one is invoked three times a second, and loop two is invoked once a Eficond, 
The first event table entry sets loops one and two to runnable in the process table. 
The system then selects loop one to run, since it runs at a faster rate than Loop two. 
Loop tivo will not run until it is the fastest loop- marked active in the process table. 
The next event occurs 1/3 of a second Later, when loop one is to be reinvoked. We 
see that in the first time slice of the diagram, loop one is active, and the system 
stack frame has the acLivar.xm record for loop one on its top. When loop one ter- 
minates, the scheduler starts the fastest active loop in the process table, in this 
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Figure 4,5; Servo leop sehcdjtUr timina diagram. The relationship between running servo 
to$pi), elapsed time, the system Eiack t tJte process table and the event Id Me are- diagrammed. 
Tv>ff loops are scheduled, rtite funitntj three times a second arid the Other Hutittnp ottts a 



case, loop two. White loop two is running, the nest event occurs: the reactivation 
of loop one, Since loop one is now the Fastest loop marked active in the process 
table, it will interrupt loop two. Thla occurs in time slice three of the diagram, 
The ;;Uick frame tiow has the acLivation record For Loop one on top of the record 
for loop two. When loop one terrn.ina.tes, its record is popped ofF the stack, and 
loop two i& roiurned. This occurs in time shce Four. In time slice five Loop two 
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terminates, none -of the servo loops are active, and the background job is resumed, 
Finally, the third event in the cycle occurs, and loop one la rein voted. After this, 
the process repeats with the first entry in the event tab]e r 

It is easy to detect when a pro<-fi=sor cannot maintain a given set of Servo loop 
rates. If a clock tick occurs and a servo loop that, the event table Indicates is 
ready to run, is already marked runuahle in the procees table, the desired servo 
rate cannot be maintained. "... -tunc, rases wc a', low servo loops to overrun :i '-i : T. 
percentage of the time. For example, an extraordinary event that may require 
extra processing, in a particular invocation of a loop can cause an Infrequent, but 
tolerable, overran. 

In timing tests It was found that the nw overheat] of invoking a procedure 
with the servo loop scheduler is low. In an application with one servo loop, 39 
microseconds wbte required to invoke the scheduler t on the average, in a test with 
four loops being ached tiled to run at the same rate, 24 microseconds were required 
to schedule each loop. In a case with eight loops being scheduled at the same 
fate t IT microseconds were needed. The decrease in av^rapie time spent within the 
Scheduler is due to the low cost of restarting a queued process. When many loops 
are scheduled at the same rate, they all are readied on the same clock tick. When 
a loop finishes the time required to start a readied, but suspended, loop is very 
low. Another way of looking at this is that scheduling a set of processes at rates 
that minimise interrupt overhead is most efficient. 

4-3.2 Intertask Communications 

In a typical control application there are a number of tasks being scheduled by the 
SLS that must communicate with one another. The tasks may be running on any 
of the micros or host computers. Without a transparent form of communication, 
each task would need the exact touting information needed for communicating 
with another routine; forcing the programmer to wire the execution structure of 

thrt overall system into 1 -a :ml yn^;-.--.!.-. 'In/i- ■..■ .-. : .-.. T.-. !:.:•.:•.■•■ r.iHiiir-; ■.■■■•: in-c. 

the task would need to use different methods of communication depending Oil 
the specific processor receiving the information, To overcome these difficulties* 
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Table 4.2: The Fields of a Me-tea^t Buffer 



Field 


Explanation 


:;.■:,:!.■; 


Virtual processor ID that Eent message. 


recipient 


Virtual processor ID to receive message. 


sender -veld 


Virtual mailb-OK foT a- reply message. 


reelpient-vdd 


Virtual mailbox to receive message. 


message- id 


One byte user assigned message type. 


message -fre« 


Flag indicating mess-age buffer is free. 


buffer-length 


Message buffer length. 


buffer 


Message buffer. 



a message passing communication system is utilized, A uniform communication 
protocol sends data between tasks running on the same processor, and between 
tasks running on different microprocessors or a host computer. 

Tasks send and receive data through uniformly formatted" messages. The fields 
in a message buEFer can be classified into two broad categories. The jlicd formal, 
fields are required, and are used by the measage passing system for specific purposes. 
The free format message buffer is optional, and is used to implement higher level 
protocols using the low level transport mechanism. 

Messages are allocated with the be Hoc routine and are deallocated using 
bfree. In general, the messages, are not freed by the processor Lhal allocated 
them, and hence bfree cannot actually release the storage. Instead > bf Tftfi just 
sets a garbage collection bit in the message buffer. At a later time the sending 
processor that issued the bailee garbage collects the freed buffers. In the current 
implementation calls to bailee periodically invoke the garbage collector, although 
other schemes, could be employed. 

A message contains information that allows the router to send it to a recipient 
process, and information that allows the recipient process to send back a reply. 
To be more specific, a recipient has two parts: the sender virtual processor, and 
a routine thai r-:i°s on that virtual processor. Most commonly, virtual pioces- 
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Tabic 4.3; Ranting tabic example. Tki* nyxtr.m hair $ virtual processors running mn $ real 
processors. 



Processor Zero 




Processor One 


Processor 


Channel 


Address 


Processor 


Channel 


Address 




seco-ft 


sr.l- 


jump-tabte-a 


zero- a 


mbus 


zero 




zero-b 


seLf 


jump-table-b 




isero-b 


mbus 


Z€IO 




one 


mbus 


one 




one 


F,--.f 


jump-table 


-^t 


VAX 


DMA 






VAX 


mbus 


aero 






















Processor VAX 








Processor 


Channel 


Address 






zero-a 


DMA 










zcro-b 


DMA 












one 


DMA 












VA X 


self 


juitip-tiible-a 









sore correspond to the real processors in the system, and the recipient is just th* 
processor number and a routine on that processor to invoke. The message buffer 
fields sender and recipient contain the virtual proceesor number of the sending 
processor and recipient processor respectively (sec Title 4.2). 

The recipient routine that is invoked when a message arrives is referred to as a 
vtrtaal device, driver (VDD). The message fictd rscipient-vdd contains an offset 
id a table on the receiving processor that points to the address of the routine that 
is invoiced for that message. Reply messages that are directed hack to the sender 
invoke the routine indicated by sender -veld. 

The table associating VDD numbers to routine addresses is referred to as the 
jump Utile, Every virtual! processor has its own jump table. The sender-vdd and 
rftC*ip£'Ydd fields contain offsets into this table, and not actual routine addresses, 
to simplify huildinp; a message passing system that runs on multiple processors. 
Since addresses are not assigned to a procedure until a program is linked, it is. 
easier to refer Lo llie VDD symbolically. The additional overhead that, this requires 
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Figure 4<4: Me#&a$e passing system, fomjwnenifl. The VDD fields point t<? gh offsr.f. in 

a )Wmp table PU the recipient prartxii&r. 
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is small, and considered acceptable, 

Figure 4.4 diagram:;- the relationships ainonj; Lhe different components of the 
message passing system. Here, the message buffer field sender -vdd contains an 
offset in the recipient processor:.- j.imp table. The jump table contains the addresses 
of the routines that correspond to the VDDs assigned to that processor, Notice that 
the redding processor has no information as to the address of the VDD routine, 
allowing dynamic modification of VDD handler assignments. The sendar-rdd 
field points to an offset in the sender's jump table. This VDD offset is used by the 
recipient processor to reply to the message. 

The actual process of sending a message is controlled by one routing table 
on each physical processor. This table associates a virtual processor name with a 
communication channel and att address on that channel,. A communication channel 
corresponds to a routine that la Invoked to send the message. The address field is 
passed as an argument to that routine. In general, each physical method of sending 
a message has on*! communication channel routine. For example, the Multibus 
channel sends messages between microprocessors connected over that LuSl The 
DMA channel sends messages between the VAX host processor and microprocessor 
zero. A pseudo channel called "self sends local messages, and in efTect causes a 
branch t.o the associated jump table for execution of the message handler. 

Table 4.3 shows the routing tables for a message passing system with Tour virtual 
processors (aero-a, zere-b, one, and VAX) that run on three real processors (zero, 
one, and VAX). In this system, only real processor zero can communicate with 
the VAX using the DMA channel. Message forwarding must be used for processor 
tine, and processor VAX to communicate. In the routing table for processor one, 
messages dc&tined to the VAX are sent to processor aero. When processor zero 
receives this message, the router notices it is intended for processor VAX. and 
uses the DMA channel to complete the transfer. An arbitrary number of message 
forwarding hops can be handled by this scheme. 

A typical message passing system is shown in Figure 4,5, Two VDDs and three 
processors have been defined. Th* aarveVDD mailbox runs on processors zero and 
One while the TaxdataYPP runs on processor VAX. The main routine, possibly 
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mainO 



message = ballocO; 

:wssege->buffer = force information; 
eb ndniB-s s age ( se rvo VDD , mes s age , ) ; 
s e lidmes b ag e (servoVDD .message . 1 ) ; 



•trvo VDD (nes s age ) 
< 

/■* process the message */ 

pros a »* _ se rvo _ fax a (ne a sa ge - >b-j f f er ) : 

/* send data to the VAX +/ 
another„message = ballocO: 
another_3iessage-> buffer * raiid*m^data ; 
sendae s sa ge ( va icdata VDD . ano ther_me s sage k V ) \ 

/* free the buffers when done +/ 
bf r &e ( me s sag* ) ; of rss ( ano ther.me s sage ) ; 
> 

vaxdataVnD^-sssQge) 

{ 

proc *s* _va x_data (me a s age - >buf f e r > : 

bfre stress age) ; 
> 

/* system wide message passing specification file */ 

OTDDUervpYDD. 01) 

*VDD<vaxdataVT>D h V> 

fiPHB CESSDR ( PRD CO . 0) 

«PR0 CESSDR (PRDC 1.1) 

6PRQ CESSOR ( PRO C VAX , V AX ) 

Fig,nrfi d.Q: Typical me&aage passing &tfetc m &pc nificatien^ Tv?e VDDs and tArrc pr*c«" 
Apr* Aflu* ifiUri rfe/trttfrf. 
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a master control program, sends a message to the servo VDD mailboxes on both 
processor aerB and processor one. Each servo VDD receives the message and then 
forwards some data to trie va;-:da^aVDD that runs on the; VAX. The menage passing 
system specification file, ahown at the bottom of the figure, is used by the system 
to build the routing and jump table structures used by this con figuration. 

A major advantage of usljiu virtual device drivers is the ease in which they can 
be relocated. For example, a VDD to invert matrices might be located on the VAX. 
If it is later decided to use a microprocessor to handle the matrix inversions we, 
just update the QVDD commands to indicate their new location and recompile the 
system. 

The cost of the flexibility provided is minimal. A J] VDD routing Ie fixed at 
compile time, and does not incur substantial runtime overhead, Tn fact, the entire 
system Is table driven. When a message arrives, the message handler issues a jump 
to the proper VDD handler. No procedure call overhead is required to proceEs the 
message. Messages exchanged between the VAX and the micros are also relatively 
fast r due to the sp^ed of the DMA link. 

The if peed of the message passing system is tit nio[:st rated hy a set of bench- 
mark tests performed Sending, a message from one microprocessor to another 
takes 'in microseconds, Sending a mess-age and receiving a return reply takes 40 
microseconds. In comparison. Digital's RSX operating system's message passing is 
slower; 20 milliseconds are required to send a message, and 60 milJisccorLds elapse 
when sending a message and receiving a reply. The time to send a message from 
a microprocesseir to the VAX> in our system, is slower. It takes 1 millisecond to 
seifid to the hand processor. This still is faster than the typical time required to 
send an RSX message. It should be noted that the speed advantage our system has 
over USX is gained by simplicity. We feel,, however, that In the domain of control 
programming no functionality has been lost. 

4,4 Performance Evaluation 

The computational architect -.ire described is r.o-w flpfiTa-tional and is actively being 
used to control the Utah-MIT hand. Initially 5 microprocessors were use in the 
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system. One processor was dedicated to each finder, and the retraining one was 
■. |n; | ■ .i! ■■. .:....; ii ■■' ii // : ■ -l:;i:.i[- 4':'. .v|i :■■■; tuiJ ■ ■:■ n -i-: : ■ i ■ .: I ■ m:- "."-■" 1 1 ■ ". lie VAX. 
However, the computational power provided proved inadequate- for some of the 
initiaJ tasks we wanted to perforin. Each 68000 provider approximate!}' 1 MIPS 
performance. If each processor servos 4 joints at JHrf) hertz, approximately 500 
integer instructions per joint pf.T Fnrvo update arc available. The C code used 
rather quickly fixreedad this ins true lion £|UQta. 

The system was then updated to 8 68000 processors, increasing overall perfor- 
mance by 3 MfPS. The computations were partitioned somewhat differently: one 
processor was assigned alE data acquisition needs, 5 processors handled finger com- 
putations, and 1 processor handled inter-ringer coordination. This leaves one spare 
computer for future expansion, This level of performance has been adequate for 
the current tasks being performed; full digital positional control and force control 
have been obtained. Floating point operations are not used in the current con- 
trol software. Instead., integer arithmetic with appropriate sealing operations is 
employed. 

The current computations being performed are far less, complex, than these 
planned for the near future. Clasping operations will require computing the equiv- 
alent of a grip jacoblan |Mason and Salisbury 196&; TIolEerbach el al. 1986 t a 
relatively complex task. In addition, the current lack of hardware floating point 
support may prove to be a problem. These computations, wilt probably require 
the use of floating point operations to avoid numerical instabilities, The current 
hardware cannot handle these needs. Their lack of floating point support ii partic- 
li.iir.v l:-ii;k>4i: p'::fm ni HR. ."■ No;i:h|- poinl nperatioc ::i software i.-u\ ■i':< r "-iki: 
50 times longer than it would take using specialized hardware. 

The Issue of whether floating point support is really required for control com- 
putations is often debated. Using integer arithmetic with proper scaling can often 
substitute for a full floating point implementation. However, certain computations 
cannot always be scaled by a fixed amount, requiring more complex dynamic scal- 
ing procedures. In the end k since the effort required to Isolate the proper staling 
operations may be large, and since dynamic scaling becomes quite complex, having 
hardware floating point capabilities is probably warranted. 
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To meet these needs, the computational architecture is currently being up- 
graded to Motorola. 65020 processors based on the VME bus. The 39020 itself 
jrives a factor of 2.5 speed i mproveTnent over the 09000 in integer airilhnietic. In 
addition, the processor supports the Motorola 63881 floating point coprocessor. 
The upgraded system will employ 10 processors giving a total of 25 MIPS inte* 
ger performance, a significant increase over the 9 MIPS available Oil the current 
system. Sun workstations, also based on the Motorola 68fl2(] architecture! will he 
used for development, Control programming wife] be simplified by using the same 
processor for both the microprocessors and the host computer. 

To port the system, only limited modification! to a few parts of the software 
library are required. The device dependent portions of Ehe code are limited to low 
level software Ei.ieh as interrupt handlers, and timer and serial port controllers. All 
higher '■:■■-••', tucitrol code ;.i entirely device indft|^i-di-m ;ind \\>y\A jusl be recnri nli-l 
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The opening paragraphs of thia thesis reflected oi\ the amazing capabilities of <mr 
hands. No robots have yet been able to- achieve their [eve] of versatility in manipula- 
tory and exploratory motions, Our hands can successfully function in unstructured 
environments that foil even the most sophisticated manipulators built to date, The 
most important shortcomings occur with their dexterity, Eensing capabilities, com- 
putational power, and algorithmic support. 

This thesis has addressed current robots* deficiencies in sensors and compu- 
tational support. The preceeding chapters discussed a tactile sensor,, a thermal 
sensor, and a computational architecture suitable for use with an advanced dex- 
terous robotic device. The tools needed for rciilm:^ a rohot suitable for use in an 
unstructured environment are now in place; the Utah-MIT hand provides a high 
level oF dexterity, the sensors provide environment feedback, and the computational 
architecture gives it the needed number crunching power. 

The next sections in this concluding chapter briefly summarize the worfc pre- 
sented ]il this tiiesis, and then discuss future research directions to be pursued, 
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5.1 Where Have We Gone So Far? 

A tactile sensor and a thermal sensor have been design and tested. The technologies 
employed permit fabrication of highly durable devices that can be mounted on 
curved surfaces like the fingers of the Utah-MIT band. Their perforciumce waa 
fmmd to be adequate for iome of the sensor driven control tasks that, arc planned 
to be implemented on, the Utah-MIT hand. 

The tactile array provides 8x8 forces sensor* with 1.9 mm center-to-center 
spacing. Each cell provides 8 bits of force data over a to 2l"K'] gram per square 
mm range- Its actual sensitivity can be controlled by varying the properties of 
its elastic-dielectric layer. The device's overall performance is influenced by the 
sl^e of the rubber tabs, the thickness of the covering sheet, and the actual silicone 
rubber used. Although Lhe capacitance being detected is small h proper electrical 
shielding minimises the noise created by parasitic affects. Hysteresis was found to 
be low, though a discussion questioned the importance of achieving low hysteresis; 
since the fingers need soft coverings, h h unlikely that hysteresis can altogether be 
eliminated. Importantly, human touch sensing has a high level of hysteresis yet it 
maintains excellent performance. 

The thermal device has a matrix of 4 X 4 cells with 3.5 mm centcr-lo-ccnter 
spacing. By heating an object and measuring the resulting temperature change at 
the sensors surface, a material's type can he deLcr mined. Since the sensor has an 
array of thermal cells, it can also detect the contact outline of an object, Several 
different materials were classified usmg their characteristic thermal profile. 

The feasibility of combining the tactile and thermal sensor into one package was 
covered. Since the thermal wrisor is passive, and does clo-L require direct mechanical 
contact with the external object beinu sensed, a layered device can be constructed 
with the thermal sensor placed below the tactile seuEor, The choice of materials is 
crucial for the performance of this dual modality device; the tactile sensor must be 
made of thermally conductive materials to allow heat to be exchanged freely with 
the thermal sensor. 

Since a sensor equipped dexterous robot will require a high degree of intelli- 
gence, and since the computational tasks that must be performed are likely to be 
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complex, a computational architecture with suitable performance was devfilopnd 
that meet these needs. The system described is actively being used to eontroi the 
Utah-MIT hand. It performs low level position and force control servos a.t rates 
high enough for adequate performance |Ifo|lerba,ch and N'arasimhari 1966'. The 
hand control strategies being used hare ample parallel ism to be partitioned on la 
a set of ft processors. The architecture is general purpose enough to permit use 
with other robotics control projects. Currently, the MIT direct drive arm utilizes 
a system based on the components of this computational architecture-. 

5.2 What Coitihs Np.x%1 

This section explores gome future areas of research in sensing and computational 
support that will be required to fully realize a dexterous hand that can operate 
in unstructured environments. The discussion Is divided into two sect.ion=. The 
first covers the Temaining work on the tactile and thermal sensors necessary for 
operating: them with the Utah-MIT band. The second discusses sortie higher level 
issues Involved with achieving sensor based control, 

5,2,1 Improving the Taciite and Thermal Sensors 

Some work remains to be done before a fully operational sensor equipped dexterous 
hand can be realized. The final details of the tactile sensor's Fabrication process 
must be worked out to Insure long term reliability, A reduction, in the size of a 
tat tile- cell to 1.2 tutu is under strong consideration. The current 1,9 mm center- to- 
center spacing is somewhat large for some planned tasks. Fortunately, the junction 
capacitance available for the smaller si Bed cells wjtl still be large enough to permit 
detection with adequate force resolution. 

Bonding wires to the flexible pad is another important consideration. Up to 
now the sensor has been mounted on a rigid printed circuit board- In the near 
future, fully flexible versions will be made that permit mounting on the curved 
surfaces of the fingers, Small wjrea must come out from the pad and be attached 
to the detection and Scanning electronics. It is important for these connections 
to be extremely reliable. An alternative design that uses a flexible printed circuit 
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board that can. be wrapped around the hand's fingers is also under development. 
This approach might lead to more reliable attachments. 

Since current plam call lor mounting 3 tactile arrays on c^ach of the hand's A 
fingers, some work must be done to further Jnlnlaturiae the scanning and detection 
cJoetrfm-ic^ Currently the only electronic* mounted near the sensor array are the 
primary row amplifier*, They must he placed near the pad to reduce stray capac- 
itance effects. To minimize the wiring nightmare that the L2 sensor pads would 
create, multiplexing must be done on the fingers themselves. Since the space avail- 
ahle 3a so small, hybrid circuit fabrication is being considered. Thus will also permit 
further signal amplification to be done close to the sensors, possibly increasing their 
overall performance. 

More attention rnu*t given to modeling the tactile sensor's performance. A 
detailed mechanical model would give a better understanding of many oF the deEign 
decisions that were made. For example, the elastic-dieEectric material! has many 
design parameters that can be varied. The actual mechanical properties of the 
silicone rubber, the size and height of the rubber labs, and the thickness of the 
surface covering can all be varied. A detailed analysis of how these factors affect 
overall sensor performance 3s certainly warranted, Alternatives to the rubber tabs 
could be considered. A continuous. Silicone rubber material with embedded air 
\>:v;\:eU. Ilfcfi ?. =.|..mh;m., i- ;■ k>. : , ."■::-,' I-.' ||: >, ' 

A sensor's reliability is of the utmost importance. Unfortunately,, putting a 
sensor in a durable package often reduces it sensitivity. The sensors discussed in 
this thesis, are fairly reliable, though much more testing is needed to ascertain their 
long term performance. Perhaps it would be best to form the sensor with an easily 
replaceable covering. Provisions must be made, however,, to allow the covering to 
bond firmly to the sensor^s surface, or had mechanical interactions between them 
might result. 

Some work remains to be done before the combination tactile and thermal sensor 
can be realized. Since the thermal sensor is to be placed behind the tactile sensor, 
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the heat capacity and heat conductivity of the elastic-dielectric materia] musL be 
suitably high- If the tactile sensor formed a thermal barrier, the performance of 
the thermal sensor would be. seriously degraded. Materials suitable fur this purpose 
must be isolated. 

5.2.2 Ssmor Bostd Hand Motions 

The broader issues or how to integrate contact sensor data into hand control strate- 
gies needs further investigation. To date, few successful system that actively uLiliise 
contact sentor data have been developed. With robots like the Utah-MIT hand 
and sensors like the ones described in this thesis, advances in this field should now 
be possible. 

A fundamental analysis of tactile sensor based operations must be performed , 
Take the task of programming the hand to grip objects and to automatically com- 
pensate for potential slippage. Firstly, the phenomena of slippage must be thor- 
oughly investigated. The exact mechanical interactions between the hand and the 
object, as seen by the fingertip contact sensors, must he quantified. Then the grasp 
planner must be designed to utilise not only the geometrical model of the object 
and the hand, but the Sensing data being acquired in real time. In essence, the 
co]LsLraints provided by sensory data must be considered with the same importance 
as those provided by the static world model. 

Much information can be gained by investigating how the human hand uses 
sensory information. Lederman and Klatiky J s [19&5] pioneering work in the area 
of haptic perception and recognition of common objects is a useful starL. They 
define a set of "knowledge directed procedures" that the haptic system might use 
to obtain information about a material ^s intrinsic properties. For example, to 
obtain an object's weight, an Unsupported holding strategy fc use J. Shape and size 
can be found by enclosure or dynamic contour exploration. Textural information 
is obtained by relative motions between the hand and the object. 

The Lederman and Klatzky work emphases, the importance of the hand as- 
a sensory organ. A robotic hand can be made to perform some of these same 
haptic functions. The sensory data it obtains can supplement other sourceo of 
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information* primarily vision. The whole, area of haptlcs and fusion of multiple 
sensory sources requires much additional research- Ultimately, a robust robotics 
system that can handle large amounts of modeling uncertainty will be. possible. In 
fat i h such a robotics device will actually be able to explore its own environment, 
obtaining the Information that It needs to accornpliFh par tir.nl ar opsraLions. 

Are there tasks that a hand with touch sensors can perform thata tiand without 
sensors is inr.apahle of achieving? This question is asked by many, though no forma! 
answer has yet been given, Most researchers in the field bdi^ve that contact sensory 
information plays a crucial role in the human hand's operations, and conclude that 
the same holds for robot hands. The robotic sensor field would be given a big 
boost by a demonstration that this assumption is really correct. Perhaps the most 
convincing argument would be a demonstration of a sensor equipped robotic hand 
performing a complex operation that to date has only been done by humans. 

Though much work remains, this- thesis has shown that an artificial hand with 
advanced sensory capabilities is- now well within our reach. The sensor equipped 
Utah-MIT hand has the potential to provide advances in automation and prosthetic 
devices, arid to give us a better understanding of motor control. Devices like this 
will allow robots to emerge from the structured world that they are confined to 
today. 
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